-- Logs begin at Tue 2022-06-21 18:11:26 UTC, end at Tue 2022-06-21 19:27:05 UTC. -- Jun 21 18:54:08.390978 dv-cinder-846303-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 18:54:08.400435 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 18:54:08 2022] *** Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: nodename: dv-cinder-846303-1-iscsi Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: machine: x86_64 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: clock source: unix Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: pcre jit disabled Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: detected number of CPU cores: 4 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: current working directory: / Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: detected binary path: /usr/bin/uwsgi-core Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: your processes number limit is 47680 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: your memory page size is 4096 bytes Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: detected max file descriptor number: 2048 Jun 21 18:54:08.402349 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: lock engine: pthread robust mutexes Jun 21 18:54:08.403270 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: thunder lock: enabled Jun 21 18:54:08.403270 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 18:54:08.403270 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 18:54:08.446946 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: Python main interpreter initialized at 0x562bbcbfe9c0 Jun 21 18:54:08.446946 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: python threads support enabled Jun 21 18:54:08.446946 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: your server socket listen backlog is limited to 100 connections Jun 21 18:54:08.446946 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: your mercy for graceful operations on workers is 90 seconds Jun 21 18:54:08.447363 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 18:54:08.447363 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: *** Operational MODE: preforking *** Jun 21 18:54:08.447641 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: *** uWSGI is running in multiple interpreter mode *** Jun 21 18:54:08.447641 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: spawned uWSGI master process (pid: 103063) Jun 21 18:54:08.447860 dv-cinder-846303-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 18:54:08.449308 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: spawned uWSGI worker 1 (pid: 103064, cores: 1) Jun 21 18:54:08.449308 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: spawned uWSGI worker 2 (pid: 103065, cores: 1) Jun 21 18:54:08.449308 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 18:54:09.113209 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:54:09.115743 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:54:10.235229 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:54:10.235229 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: from cryptography.utils import int_from_bytes Jun 21 18:54:10.235859 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:54:10.235859 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: from cryptography.utils import int_from_bytes Jun 21 18:54:10.237240 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:54:10.237240 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: from cryptography.utils import int_from_bytes Jun 21 18:54:10.237692 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:54:10.237692 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: from cryptography.utils import int_from_bytes Jun 21 18:54:12.686285 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:54:12.686829 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:54:12.687059 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:54:12.687420 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:54:12.687678 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:54:12.688066 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.688158 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:54:12.689021 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:54:12.689154 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.689281 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.689424 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:54:12.689604 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.689802 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:54:12.689956 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.690057 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:54:12.690228 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.690442 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.690550 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.690775 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.690877 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691105 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691192 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691429 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691514 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691748 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.691847 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692064 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692157 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-1-iscsi {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692382 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692474 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692686 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692774 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.692998 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693119 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693306 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693407 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693630 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693739 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.693944 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694028 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-1-iscsi {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694249 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694345 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694575 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694752 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.694893 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695206 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695319 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695514 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695616 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695824 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.695914 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696133 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696230 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696466 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696650 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696768 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.696966 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697079 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697317 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697442 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697637 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697726 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.697980 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698081 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698306 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698447 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-1-iscsi {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698624 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698722 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.698950 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699081 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699265 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699359 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699597 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699728 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.699910 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700040 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700311 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-1-iscsi {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700406 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700633 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700737 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.700953 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701058 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701299 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701386 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701630 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701715 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.701955 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702056 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702273 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702361 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702591 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702685 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.702984 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703200 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703286 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703507 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703595 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703824 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.703921 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.704706 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.704813 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705013 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705133 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705293 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705382 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705602 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705700 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.705922 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706018 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706241 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706337 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706562 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706651 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706815 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.706912 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707065 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707153 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707414 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707510 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707740 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.707839 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708072 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708157 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708400 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708486 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708660 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708749 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.708918 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709006 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709269 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709373 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709599 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709706 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.709917 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710028 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710221 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710320 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710532 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710641 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710845 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.710937 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711155 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711256 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711461 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711560 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711769 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.711864 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712081 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712179 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712404 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712516 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712708 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.712800 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713034 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713146 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713374 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713464 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713681 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713791 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.713999 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714105 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714318 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714404 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714624 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714709 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.714928 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715064 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715236 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715324 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715552 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715653 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715889 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.715975 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716188 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716279 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716438 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716538 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716734 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.716821 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717037 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717193 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717440 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717536 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717750 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.717836 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718056 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718142 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718311 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718406 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718704 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.718929 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719031 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719230 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719332 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719564 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719665 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719890 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.719979 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720196 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720294 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720499 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720586 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720803 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.720898 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721120 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721212 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721424 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721522 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721747 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.721842 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722061 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722147 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722363 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722449 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722666 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722759 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.722970 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723058 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723273 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723360 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723588 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723674 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.723988 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724197 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724295 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724507 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724592 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724806 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.724893 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725127 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725250 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725447 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725539 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725751 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.725842 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726054 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726152 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726372 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726470 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726765 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.726970 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727067 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727284 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727381 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727586 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727688 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727885 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.727975 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728186 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728285 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728486 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728575 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728786 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.728876 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729113 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729406 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729503 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729706 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.729816 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730002 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730192 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730310 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730412 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730620 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730709 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.730924 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731020 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731227 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731312 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731526 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731611 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731829 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.731915 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.732150 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.732237 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.732476 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.732570 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.732791 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.732879 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.733118 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.733208 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.733432 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.733519 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.733755 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:54:12.733843 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734068 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734154 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734377 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734525 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734691 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.734781 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735013 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735099 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735375 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735533 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735685 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735873 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.735995 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736197 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736517 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736612 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736837 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.736925 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737200 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737301 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737522 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737610 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737840 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.737941 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738160 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738246 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738473 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738561 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738795 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.738880 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739114 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739200 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739421 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739509 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739743 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.739830 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740066 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740153 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740384 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740483 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740701 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.740786 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741018 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741152 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741362 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741449 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741672 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741759 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.741986 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742086 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742306 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742394 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742637 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742723 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.742947 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743044 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743263 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743350 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743575 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743661 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743886 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.743982 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744195 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744281 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744506 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744595 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744816 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.744908 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745169 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745259 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745483 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745568 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745799 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.745888 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746111 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746199 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746425 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746519 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746734 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.746827 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747042 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747129 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747351 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747437 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747653 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747741 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.747955 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748053 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748256 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748351 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748561 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748648 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748861 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.748949 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749200 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749304 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749525 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749611 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749831 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.749918 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.750139 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.750241 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.750453 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.750574 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.750761 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.751349 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.751588 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.751689 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.751894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.751979 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752202 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752296 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752516 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752612 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752825 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.752921 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753150 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753248 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753476 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753572 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753785 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.753872 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754089 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754184 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754399 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754532 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754701 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.754830 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755003 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755093 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755313 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755412 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755620 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755709 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.755928 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756014 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756239 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756324 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756543 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756629 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756863 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.756963 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757192 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757282 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757505 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757593 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757817 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.757913 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758134 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758220 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758446 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758539 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758764 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.758860 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.759085 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.759171 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.759399 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.759486 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.759715 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.760054 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.760393 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.760626 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.760944 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.761278 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.761589 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.761680 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.761894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.761990 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762205 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762292 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762508 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762596 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762813 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.762899 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763122 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763217 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763424 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763513 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763727 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.763815 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764050 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764137 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764359 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764454 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764664 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764757 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.764965 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765061 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765293 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765381 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765601 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765697 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.765914 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.766010 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.766242 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.766329 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767105 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767199 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767420 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767520 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767731 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.767817 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768042 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768127 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768356 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768454 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768754 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.768981 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769068 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769318 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769408 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769632 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769719 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.769951 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770047 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770262 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770356 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770581 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770726 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770892 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.770979 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771215 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771321 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771528 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771615 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771842 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.771927 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772146 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772241 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772462 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772549 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772785 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.772879 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773153 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773245 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773452 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773551 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773768 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.773863 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774077 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774162 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774389 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774475 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774695 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.774790 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775006 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775092 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775318 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775406 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775628 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775769 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.775946 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776040 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776256 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776351 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776572 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776666 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776879 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.776965 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777222 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777311 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777532 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777619 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777850 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.777935 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778150 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778344 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778450 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778533 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778778 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.778865 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779089 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779174 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779402 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779490 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779713 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.779799 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780033 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780121 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780340 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780427 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780644 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780730 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.780953 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781048 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781338 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781642 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781739 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.781949 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782046 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782315 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782409 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782625 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782711 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.782936 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783030 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783237 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783322 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783549 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783635 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.783856 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784022 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784157 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784244 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784457 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784552 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784768 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.784863 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785082 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785245 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785414 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785512 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785732 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.785864 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786045 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786141 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786343 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786430 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786644 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786739 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.786961 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787046 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787265 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787354 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787567 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787668 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787868 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.787956 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788170 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788265 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788509 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788603 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788813 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.788899 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789134 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789243 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789454 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789543 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789773 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.789861 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790079 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790179 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790388 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790474 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790694 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.790781 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791003 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791100 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791322 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791409 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791735 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.791942 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792030 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792253 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792339 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792561 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792650 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792873 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.792967 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793210 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793299 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793533 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793631 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793841 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.793937 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794153 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794240 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794463 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794551 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794765 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.794860 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795076 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795173 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795392 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795490 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795723 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.795965 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796053 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796297 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796384 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796612 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796700 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.796929 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797023 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797272 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797361 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797589 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797677 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.797965 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798195 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798284 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798535 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798857 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.798957 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799188 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799282 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799500 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799593 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799804 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.799900 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800112 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800209 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800415 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800504 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800717 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.800805 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801018 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801167 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801354 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801453 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801656 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801757 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.801957 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802043 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802258 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802353 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802559 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802648 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802869 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.802956 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803173 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803260 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803484 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803572 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803785 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.803873 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804090 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804176 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804398 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804485 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804702 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.804807 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805001 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805105 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805328 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805417 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805646 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805732 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.805959 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806090 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806288 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806376 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806604 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806700 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.806916 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807011 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807224 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807311 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807527 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807612 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.807851 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808017 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808156 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808243 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808458 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808552 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808760 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.808860 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809065 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809207 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809394 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809492 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809695 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.809797 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810004 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810099 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810566 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810697 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810874 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.810971 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811181 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811275 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811482 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811568 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811788 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.811875 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812090 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812176 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812403 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812490 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812709 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.812805 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.813016 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.813122 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.813869 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.813976 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814180 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814268 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814486 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814572 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814788 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.814892 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815097 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815184 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815398 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815529 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815705 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.815841 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816004 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816126 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816305 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816392 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816603 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816704 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.816908 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817002 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817238 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817340 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817541 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817629 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817861 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.817946 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818172 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818260 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818482 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818582 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818790 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.818940 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819106 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819241 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819426 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819545 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819734 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.819850 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820061 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820149 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820382 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820471 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820694 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.820782 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821004 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821116 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821345 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821432 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821655 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821742 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.821959 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822056 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822264 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822359 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822573 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822659 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822873 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.822974 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823173 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823267 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823478 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823566 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823779 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.823875 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824079 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824173 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824386 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824472 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824689 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824776 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.824991 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825131 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825319 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825409 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825623 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825713 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.825930 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826015 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826239 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826325 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826567 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826656 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826883 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.826970 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827193 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827279 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827501 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827588 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827812 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.827899 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828120 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828214 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828433 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828519 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828737 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.828824 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.829692 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.829801 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830018 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830104 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830348 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830437 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830653 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830747 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.830960 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831048 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831281 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831365 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831590 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831690 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831903 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.831998 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832218 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832304 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832536 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832631 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832843 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.832928 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833176 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833265 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833488 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833577 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833800 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.833886 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834108 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834196 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834418 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834505 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834726 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.834813 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835037 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835124 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835348 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835436 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835659 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835745 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.835969 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836064 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836277 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836366 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836585 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836684 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.836991 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.837225 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.837317 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.837531 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.837618 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.837852 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838019 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838158 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838245 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838458 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838545 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838765 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.838860 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839068 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839163 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839377 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839472 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839679 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.839775 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840006 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840091 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840323 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840410 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840637 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840779 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.840950 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841046 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841288 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841379 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841606 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841693 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841915 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.841999 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.842226 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.842353 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.842529 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.842673 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.842941 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843027 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843257 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843343 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843568 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843657 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843878 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.843965 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844180 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844275 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844482 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844570 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844815 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.844901 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845160 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845335 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845470 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845656 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845744 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.845976 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846059 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846297 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846384 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846610 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846696 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.846925 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847038 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847241 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847383 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847570 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847696 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.847880 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848002 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848190 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848417 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848512 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848728 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.848817 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849036 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849172 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849381 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849468 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849702 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.849859 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850026 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850178 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850329 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850490 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850643 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.850910 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851012 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851229 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851316 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851545 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851654 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851860 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.851948 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852173 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852269 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852475 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852561 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852793 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.852883 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853127 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853218 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853443 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853531 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853763 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.853852 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854089 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854177 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854407 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854494 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854727 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.854825 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855036 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855125 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855364 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855451 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855686 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855774 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.855991 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856087 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856300 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856414 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856606 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856722 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.856911 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857035 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857257 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857376 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857563 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857706 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.857873 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858035 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858182 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858346 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858489 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858653 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858792 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.858968 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859094 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859284 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859414 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859594 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859716 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.859922 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860035 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860305 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860411 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860639 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860727 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.860956 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861044 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861308 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861410 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861703 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.861926 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862012 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862228 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862328 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862532 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862620 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862842 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.862929 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863169 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863263 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863479 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863573 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863798 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.863886 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864108 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864196 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864436 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864524 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864743 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.864830 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865051 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865165 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865385 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865473 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865696 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.865782 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866013 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866101 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866335 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866422 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866638 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866725 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.866941 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867029 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867250 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867336 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867555 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867651 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867858 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.867945 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868159 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868255 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868466 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868563 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868766 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.868856 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869066 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869202 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869392 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869517 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869715 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.869811 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870019 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870113 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870440 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870647 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870735 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.870949 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871044 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871251 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871339 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871551 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871646 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871891 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.871987 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872193 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872282 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872522 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872608 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872836 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.872933 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873174 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873278 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873500 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873595 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873806 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.873907 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874113 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874200 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874421 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874507 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874739 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.874834 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.875063 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.875150 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.875402 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.875498 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.875716 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.876308 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.876558 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.876648 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.876875 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.876965 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877207 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877310 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877524 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877612 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877838 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.877924 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.878153 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.878292 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.878473 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.878702 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.878799 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879031 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879128 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879345 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879442 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879654 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879741 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.879963 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880060 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880276 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880364 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880590 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880686 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880900 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.880997 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.881233 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.881503 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.881592 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.881840 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.881937 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882161 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882289 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882479 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882566 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882796 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.882896 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883117 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883204 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883435 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883523 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883750 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.883847 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884062 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884150 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884377 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884489 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884691 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.884789 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885045 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885163 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885362 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885490 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885688 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.885787 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.886032 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.886178 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.886359 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.886681 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.886771 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.887003 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.887227 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.887315 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.887675 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.887806 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.888001 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.888318 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.888403 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.888639 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.888941 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.889036 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.889308 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.889525 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.889614 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.889931 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.890113 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.890251 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.890570 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.890697 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.890888 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.891204 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.891300 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.892102 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.892351 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.892439 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.892778 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.892864 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893144 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893235 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893477 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893562 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893800 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.893902 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.894124 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.894220 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.894466 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.894753 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.894976 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895149 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895302 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895397 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895645 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895732 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.895981 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896080 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896315 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896429 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896640 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896756 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.896965 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897103 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897325 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897413 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897640 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897739 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.897951 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898040 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898269 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898355 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898585 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898671 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898895 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.898991 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899222 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899309 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899532 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899627 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899842 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.899929 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.900155 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.900241 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.900473 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.900682 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901009 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901119 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901379 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901466 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901702 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.901802 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902031 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902117 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902351 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902438 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902661 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902757 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.902973 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903059 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903291 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903377 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903599 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903695 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903909 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.903994 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904221 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904307 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904528 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904629 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904833 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.904921 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905162 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905265 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905474 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905562 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905780 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.905875 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906089 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906175 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906396 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906484 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906707 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.906793 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907022 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907127 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907369 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907457 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907673 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907767 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.907982 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908082 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908289 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908378 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908596 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908692 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.908903 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909000 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909238 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909327 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909550 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909639 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909855 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.909956 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910162 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910249 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910466 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910553 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910777 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.910876 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911077 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911165 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911386 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911473 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911698 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.911793 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912055 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912143 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912362 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912486 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912672 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912760 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.912982 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913123 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913319 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913415 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913635 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913723 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.913946 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914032 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914258 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914347 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914574 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914662 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.914910 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.915009 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.915238 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.915448 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.915778 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.915868 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916096 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916229 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916428 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916534 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916760 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.916891 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917069 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917179 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917396 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917495 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917703 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.917792 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918013 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918113 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918321 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918417 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918630 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918718 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.918938 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919025 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919251 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919339 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919560 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919647 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919868 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.919955 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920175 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920302 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920620 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920723 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920806 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.920901 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921077 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921187 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921409 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921499 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921718 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.921816 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922027 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922154 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922339 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922676 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.922773 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923014 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923102 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923332 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923428 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923650 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.923967 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924054 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924275 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924363 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924583 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924747 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924894 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.924982 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925227 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925331 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925541 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925636 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925864 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.925952 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926174 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926300 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926480 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926569 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926803 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.926927 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927204 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927291 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927521 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927611 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927843 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.927932 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928154 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928250 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928472 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928566 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928790 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.928876 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929157 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929268 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929449 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929537 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929758 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.929844 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930081 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930180 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930417 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930506 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930744 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.930831 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931069 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931159 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931375 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931463 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931678 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931767 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.931982 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932071 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932291 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932379 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932610 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932697 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.932922 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933016 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933256 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933346 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933561 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933662 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933868 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.933955 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934170 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934333 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934475 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934573 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934778 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.934866 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.935079 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.935174 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.935638 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.935735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.935939 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936025 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936239 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936378 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936540 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936643 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936841 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.936929 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937164 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937268 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937468 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937572 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937773 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.937859 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.938074 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.938171 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.938886 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.938983 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939189 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939326 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939493 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939642 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939793 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.939962 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940124 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940270 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940454 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940611 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940768 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.940951 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941099 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941300 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941416 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941629 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941726 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.941951 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942280 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942367 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942598 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942687 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.942926 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943013 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943241 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943327 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943559 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943647 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943867 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.943953 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944180 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944269 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944490 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944579 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944799 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.944887 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945147 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945253 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945435 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945523 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.945837 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946067 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946168 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946371 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946499 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946697 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.946786 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947014 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947150 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947334 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947429 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947648 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947745 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.947961 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948051 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948282 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948369 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948590 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948676 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948898 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.948987 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949236 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949338 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949549 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949645 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949859 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.949955 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950176 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950264 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950492 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950587 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950814 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.950901 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951136 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951222 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951442 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951537 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951765 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.951857 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952089 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952175 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952422 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952524 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952741 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.952828 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953132 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953225 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953428 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953525 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953741 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.953840 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.954113 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.954898 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.955074 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.955168 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:54:12.955258 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.955562 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.955876 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:54:12.956130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:54:13.108716 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO dbcounter [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Registered counter for database nova_api Jun 21 18:54:13.109801 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO dbcounter [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Registered counter for database nova_api Jun 21 18:54:13.129249 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_db.sqlalchemy.engines [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.131013 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_db.sqlalchemy.engines [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.135932 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writer thread running {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.137616 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writer thread running {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.194546 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.context [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfe881bf-3b81-4d90-a9e4-cd38631b724f(cell1) {{(pid=103065) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:54:13.196717 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.context [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfe881bf-3b81-4d90-a9e4-cd38631b724f(cell1) {{(pid=103064) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:54:13.198536 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:54:13.200099 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:54:13.200712 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_concurrency.lockutils [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:54:13.200902 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:54:13.202315 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_concurrency.lockutils [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:54:13.202866 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:54:13.203123 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_concurrency.lockutils [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:54:13.205440 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO dbcounter [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Registered counter for database nova_cell0 Jun 21 18:54:13.205668 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_concurrency.lockutils [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103064) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:54:13.207684 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO dbcounter [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Registered counter for database nova_cell0 Jun 21 18:54:13.209678 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO dbcounter [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Registered counter for database nova_cell1 Jun 21 18:54:13.211803 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO dbcounter [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Registered counter for database nova_cell1 Jun 21 18:54:13.217042 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_db.sqlalchemy.engines [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.219298 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_db.sqlalchemy.engines [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.220797 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_db.sqlalchemy.engines [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.224178 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writer thread running {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.224308 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_db.sqlalchemy.engines [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.226830 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writer thread running {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.370696 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writer thread running {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.373281 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writer thread running {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.380416 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO dbcounter [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Registered counter for database nova_cell0 Jun 21 18:54:13.383343 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO dbcounter [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Registered counter for database nova_cell0 Jun 21 18:54:13.389525 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_db.sqlalchemy.engines [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.392980 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG oslo_db.sqlalchemy.engines [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:54:13.394081 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writer thread running {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.397509 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writer thread running {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:54:13.731036 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: WARNING keystonemiddleware.auth_token [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:54:13.733446 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: WARNING keystonemiddleware.auth_token [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:54:13.738789 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: WARNING keystonemiddleware.auth_token [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:54:13.741141 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: WARNING keystonemiddleware.auth_token [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:54:14.077555 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: WARNING keystonemiddleware.auth_token [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:54:14.079664 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: WARNING keystonemiddleware.auth_token [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:54:14.083430 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: WARNING keystonemiddleware.auth_token [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:54:14.085567 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: WARNING keystonemiddleware.auth_token [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:54:14.088682 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bbcbfe9c0 pid: 103064 (default app) Jun 21 18:54:14.090773 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:54:14.090902 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bbcbfe9c0 pid: 103065 (default app) Jun 21 18:54:14.091937 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-84e22ac6-99f9-402b-b4f6-20087dfeb151 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jun 21 18:54:14.092346 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Tue Jun 21 18:54:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:30.106979 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:30.108372 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Jun 21 18:55:30.113769 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:30.121477 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_api:SELECT=3 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:30.122633 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_cell0:SELECT=3 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:30.123949 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_cell1:SELECT=3 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:30.125382 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:30.561565 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-6c22712f-371b-4a8a-b931-fa32d5410d20 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:30.590966 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-6c22712f-371b-4a8a-b931-fa32d5410d20 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475839 Jun 21 18:55:30.591820 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 18:55:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:32.713412 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:32.714432 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-28187c74-d332-4bde-b3fb-4fbae1e62be6 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 21 18:55:32.714836 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:32.784277 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-5fd3a490-87fb-4bd5-8a31-f69dc8055737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:32.803834 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:55:32.803834 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: warnings.warn(msg) Jun 21 18:55:32.839310 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-5fd3a490-87fb-4bd5-8a31-f69dc8055737 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.117609 Jun 21 18:55:32.845287 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:33.062600 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-bc07317d-3abe-48d8-839b-634b6e342f46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:33.064927 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:55:33.064927 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 18:55:33.085018 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_api:SELECT=3 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:33.086337 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_cell1:SELECT=3 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:33.087618 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_cell0:SELECT=3 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:33.088457 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:55:33.139012 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-bc07317d-3abe-48d8-839b-634b6e342f46 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289643 Jun 21 18:55:33.139677 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 18:55:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:35.224171 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-5fd3a490-87fb-4bd5-8a31-f69dc8055737 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:35.225224 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-5fd3a490-87fb-4bd5-8a31-f69dc8055737 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 21 18:55:35.225632 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:35.336607 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7f3d49f4-758b-4a02-9e1b-416624f191c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:35.353709 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:55:35.353709 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 18:55:35.372326 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-7f3d49f4-758b-4a02-9e1b-416624f191c5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140799 Jun 21 18:55:35.372886 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:35.385883 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-401688b5-e0d2-4dff-8acb-aa9870408c24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:35.395396 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:55:35.395396 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: warnings.warn(msg) Jun 21 18:55:35.428656 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-401688b5-e0d2-4dff-8acb-aa9870408c24 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046885 Jun 21 18:55:35.429204 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 18:55:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:55:37.498921 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7f3d49f4-758b-4a02-9e1b-416624f191c5 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:37.500503 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-7f3d49f4-758b-4a02-9e1b-416624f191c5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jun 21 18:55:37.500903 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:37.567633 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-a5ff0329-4a9f-4927-8674-33ad9b086085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "name": "ds1G"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:37.587778 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-a5ff0329-4a9f-4927-8674-33ad9b086085 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080076 Jun 21 18:55:37.588410 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:37.600396 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-e0de5886-ef22-446a-bae0-6c759f22cc12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:37.624996 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-e0de5886-ef22-446a-bae0-6c759f22cc12 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027633 Jun 21 18:55:37.625798 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 18:55:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:55:39.801708 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-a5ff0329-4a9f-4927-8674-33ad9b086085 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:39.803681 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-a5ff0329-4a9f-4927-8674-33ad9b086085 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Jun 21 18:55:39.810445 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:39.898477 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-a80c92d2-2f06-4abe-9cb7-58bf0ce012b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:39.916974 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-a80c92d2-2f06-4abe-9cb7-58bf0ce012b8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.105976 Jun 21 18:55:39.918763 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:39.929695 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-31b3504d-e745-4af4-9141-fca23e0d633b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:39.954294 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-31b3504d-e745-4af4-9141-fca23e0d633b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028612 Jun 21 18:55:39.954878 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 18:55:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:42.060004 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-a80c92d2-2f06-4abe-9cb7-58bf0ce012b8 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:42.061009 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-a80c92d2-2f06-4abe-9cb7-58bf0ce012b8 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 21 18:55:42.061735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:42.120203 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "disk": 20, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:42.138180 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070652 Jun 21 18:55:42.138855 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:42.150530 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-8feab705-5f2f-441f-b86f-9015f5e62df5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:42.174715 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-8feab705-5f2f-441f-b86f-9015f5e62df5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027760 Jun 21 18:55:42.175387 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 18:55:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:44.271373 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:44.272377 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 21 18:55:44.272774 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:44.336787 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-667d505a-fc20-4b5f-94cb-2531010ef7b8 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:44.361126 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-667d505a-fc20-4b5f-94cb-2531010ef7b8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082003 Jun 21 18:55:44.361936 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 18:55:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:55:46.489060 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:46.490083 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-a922d053-c32f-48e5-9f4b-7a5707e97b81 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 21 18:55:46.490487 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:46.554196 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-b89d0da8-5655-41e1-ad03-c5090c2e93ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:46.578255 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-b89d0da8-5655-41e1-ad03-c5090c2e93ef admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081381 Jun 21 18:55:46.579039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:46.594844 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-4db40dba-bb14-493c-a66c-0135afa05ac1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:46.622096 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-4db40dba-bb14-493c-a66c-0135afa05ac1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032287 Jun 21 18:55:46.622714 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 18:55:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:48.747194 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-b89d0da8-5655-41e1-ad03-c5090c2e93ef admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:48.748566 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-b89d0da8-5655-41e1-ad03-c5090c2e93ef admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jun 21 18:55:48.749035 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:55:48.816880 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-38edb88c-bd5b-4939-98ef-c22becb22dea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:48.835115 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-38edb88c-bd5b-4939-98ef-c22becb22dea admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079210 Jun 21 18:55:48.835683 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:48.848615 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-8ff93c16-d1b6-4f00-8954-9f61c3b26460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:48.876766 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-8ff93c16-d1b6-4f00-8954-9f61c3b26460 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032690 Jun 21 18:55:48.877582 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 18:55:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:51.208496 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-38edb88c-bd5b-4939-98ef-c22becb22dea admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:51.209568 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-38edb88c-bd5b-4939-98ef-c22becb22dea admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 21 18:55:51.209981 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:51.271092 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-3f77508e-b5d9-4fe1-83e7-275a693110b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "ram": 4096, "swap": 0}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:51.304934 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-3f77508e-b5d9-4fe1-83e7-275a693110b7 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.089058 Jun 21 18:55:51.305539 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:55:51.317908 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-fbe32acb-f0a3-444d-be21-5a17a8c2296f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:51.343914 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-fbe32acb-f0a3-444d-be21-5a17a8c2296f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029152 Jun 21 18:55:51.344512 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 18:55:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:53.791947 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-3f77508e-b5d9-4fe1-83e7-275a693110b7 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:53.792952 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-3f77508e-b5d9-4fe1-83e7-275a693110b7 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 21 18:55:53.793601 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:53.853459 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-1c51c7ad-9dee-4202-b3a0-b4d1145e7f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:53.871488 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-1c51c7ad-9dee-4202-b3a0-b4d1145e7f9d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071723 Jun 21 18:55:53.872228 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:53.884256 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-6389a4cb-165c-4a3f-a0fe-1e2edec845ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:53.914522 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-6389a4cb-165c-4a3f-a0fe-1e2edec845ac admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033827 Jun 21 18:55:53.915218 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 18:55:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:55:56.005341 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-1c51c7ad-9dee-4202-b3a0-b4d1145e7f9d admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:55:56.006427 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-1c51c7ad-9dee-4202-b3a0-b4d1145e7f9d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 21 18:55:56.006855 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:55:56.068254 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "disk": 160, "swap": 0, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:56.087497 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074454 Jun 21 18:55:56.088128 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 18:55:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:55:56.101536 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-fea19f81-a73e-48e8-be91-3e71059ff3fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:55:56.127016 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-fea19f81-a73e-48e8-be91-3e71059ff3fc admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029308 Jun 21 18:55:56.127940 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 18:55:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:56:21.293514 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:21.294522 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 21 18:56:21.294920 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:21.305332 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:56:21.356524 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-62df274b-793b-4500-83b2-61c3843ce112 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:21.373481 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-62df274b-793b-4500-83b2-61c3843ce112 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072784 Jun 21 18:56:21.374010 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 18:56:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:22.296083 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:22.297153 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-98952937-a4a2-4f97-8883-121c869d9277 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 21 18:56:22.297562 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:22.489030 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-5c03fba4-2650-40f6-83e0-7d5c9239fd5d admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:22.494709 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.wsgi [None req-5c03fba4-2650-40f6-83e0-7d5c9239fd5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-5c03fba4-2650-40f6-83e0-7d5c9239fd5d admin admin] Request method failure captured: Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept: application/json Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept-Encoding: gzip, deflate Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Connection: keep-alive Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Content-Length: 0 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Host: 10.222.0.70 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-System-Scope: None Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: User-Agent: python-novaclient Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Auth-Token: gAAAAABishRWnEviXSc37-6oUEZUSSiGR4xBxFhe0PPCPfoQ0B9L2OOdax6uul6GR4gcNffIHMOiGe9Doh-ofLe6jzd3R87aL3T20xOB4T35QJ_bWkBuZtp5Hk9kUg25xJEjA6bJfWzN3MksYV35RCwDmrC4rCeuz6KGi_T0OL9ldE7VUQeGeIg Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Id: None Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Name: None Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Identity-Status: Confirmed Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Is-Admin-Project: True Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Id: default Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Name: Default Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Name: admin Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Role: reader,member,admin Jun 21 18:56:22.497992 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Roles: reader,member,admin Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant: admin Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Name: admin Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User: admin Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Id: default Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Name: Default Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Name: admin Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: method: > Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: exception: Flavor 42 could not be found. Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: action_args: {'id': '42'} Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:22.499617 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:22.500558 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.501749 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-5c03fba4-2650-40f6-83e0-7d5c9239fd5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:22.502897 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-5c03fba4-2650-40f6-83e0-7d5c9239fd5d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063371 Jun 21 18:56:22.502897 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 18:56:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:22.509197 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-75fe00d9-a70d-4a64-8648-5eeb62559a67 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:22.511978 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:56:22.531870 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-75fe00d9-a70d-4a64-8648-5eeb62559a67 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026320 Jun 21 18:56:22.532409 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:22.541946 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-7b799830-508e-4845-965b-b54e4469d149 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:22.565056 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-7b799830-508e-4845-965b-b54e4469d149 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026612 Jun 21 18:56:22.565606 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:56:22.575870 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7739bfcd-2da4-48c7-aa1f-88f34b722ee2 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:22.582404 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.wsgi [None req-7739bfcd-2da4-48c7-aa1f-88f34b722ee2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7739bfcd-2da4-48c7-aa1f-88f34b722ee2 admin admin] Request method failure captured: Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept: application/json Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept-Encoding: gzip, deflate Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Connection: keep-alive Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Content-Length: 0 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Host: 10.222.0.70 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-System-Scope: None Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: User-Agent: python-novaclient Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Auth-Token: gAAAAABishRWnEviXSc37-6oUEZUSSiGR4xBxFhe0PPCPfoQ0B9L2OOdax6uul6GR4gcNffIHMOiGe9Doh-ofLe6jzd3R87aL3T20xOB4T35QJ_bWkBuZtp5Hk9kUg25xJEjA6bJfWzN3MksYV35RCwDmrC4rCeuz6KGi_T0OL9ldE7VUQeGeIg Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Id: None Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Name: None Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Identity-Status: Confirmed Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Is-Admin-Project: True Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Id: default Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Name: Default Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Name: admin Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Role: reader,member,admin Jun 21 18:56:22.585735 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Roles: reader,member,admin Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant: admin Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Name: admin Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User: admin Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Id: default Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Name: Default Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Name: admin Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: method: > Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: exception: Flavor 42 could not be found. Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: action_args: {'id': '42'} Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:22.587339 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:22.588309 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:22.589635 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7739bfcd-2da4-48c7-aa1f-88f34b722ee2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:22.590847 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-7739bfcd-2da4-48c7-aa1f-88f34b722ee2 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015822 Jun 21 18:56:22.590847 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 18:56:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:23.409780 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-7b799830-508e-4845-965b-b54e4469d149 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:23.410805 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-7b799830-508e-4845-965b-b54e4469d149 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 21 18:56:23.411198 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:23.599955 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-5e699a05-a8a0-432f-ac56-d82b166c968a admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:23.605879 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.wsgi [None req-5e699a05-a8a0-432f-ac56-d82b166c968a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-5e699a05-a8a0-432f-ac56-d82b166c968a admin admin] Request method failure captured: Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept: application/json Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept-Encoding: gzip, deflate Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Connection: keep-alive Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Content-Length: 0 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Host: 10.222.0.70 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-System-Scope: None Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: User-Agent: python-novaclient Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Auth-Token: gAAAAABishRXYMsttDSavQNFMDhahn-H0W1-iVqEitwRR3OkfTH8na7nQQ5nL5l2W74iTaa_QByhua0hUP1qMa1XxyfePIdlhVRSUE3k58bIbrImg6iv1iPjbS2PQWNjZCkTCuWO-43v3QMyTttzZOf1NsbtdP1ObL6Ij1OI18fAWk9lEUAfov0 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Id: None Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Name: None Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Identity-Status: Confirmed Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Is-Admin-Project: True Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Id: default Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Name: Default Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Name: admin Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Role: reader,member,admin Jun 21 18:56:23.607425 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Roles: reader,member,admin Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant: admin Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Name: admin Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User: admin Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Id: default Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Name: Default Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Name: admin Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: method: > Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: exception: Flavor 84 could not be found. Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: action_args: {'id': '84'} Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:23.609668 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:23.610683 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.612039 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-5e699a05-a8a0-432f-ac56-d82b166c968a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:23.613384 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-5e699a05-a8a0-432f-ac56-d82b166c968a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061197 Jun 21 18:56:23.613384 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 18:56:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:23.618915 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-f1b5c2fb-6fbf-4bc2-9414-a4e0a47a6a82 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:23.632969 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-f1b5c2fb-6fbf-4bc2-9414-a4e0a47a6a82 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017586 Jun 21 18:56:23.633517 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:23.642852 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-52180c22-5f44-497c-9956-b6d8bf030baa admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:23.657824 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-52180c22-5f44-497c-9956-b6d8bf030baa admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018480 Jun 21 18:56:23.658349 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:23.667459 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-97cd7b02-38fc-46c1-9094-4d77baef4d65 admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:23.673256 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.wsgi [None req-97cd7b02-38fc-46c1-9094-4d77baef4d65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-97cd7b02-38fc-46c1-9094-4d77baef4d65 admin admin] Request method failure captured: Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept: application/json Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept-Encoding: gzip, deflate Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Connection: keep-alive Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Content-Length: 0 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Host: 10.222.0.70 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-System-Scope: None Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: User-Agent: python-novaclient Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Auth-Token: gAAAAABishRXYMsttDSavQNFMDhahn-H0W1-iVqEitwRR3OkfTH8na7nQQ5nL5l2W74iTaa_QByhua0hUP1qMa1XxyfePIdlhVRSUE3k58bIbrImg6iv1iPjbS2PQWNjZCkTCuWO-43v3QMyTttzZOf1NsbtdP1ObL6Ij1OI18fAWk9lEUAfov0 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Id: None Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Name: None Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Identity-Status: Confirmed Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Is-Admin-Project: True Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Id: default Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Name: Default Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Name: admin Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Role: reader,member,admin Jun 21 18:56:23.674751 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Roles: reader,member,admin Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant: admin Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Name: admin Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User: admin Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Id: default Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Name: Default Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Name: admin Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: method: > Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: exception: Flavor 84 could not be found. Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: action_args: {'id': '84'} Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:23.676130 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:23.677019 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:23.678216 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-97cd7b02-38fc-46c1-9094-4d77baef4d65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:23.679254 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-97cd7b02-38fc-46c1-9094-4d77baef4d65 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012241 Jun 21 18:56:23.679254 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 18:56:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:24.492017 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-52180c22-5f44-497c-9956-b6d8bf030baa admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:24.493058 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-52180c22-5f44-497c-9956-b6d8bf030baa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 21 18:56:24.493812 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:24.686290 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-4f4f71c8-20d3-4495-ae5d-0b409cf5099c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:24.692234 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.wsgi [None req-4f4f71c8-20d3-4495-ae5d-0b409cf5099c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-4f4f71c8-20d3-4495-ae5d-0b409cf5099c admin admin] Request method failure captured: Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept: application/json Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Accept-Encoding: gzip, deflate Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Connection: keep-alive Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Content-Length: 0 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Host: 10.222.0.70 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Openstack-System-Scope: None Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: User-Agent: python-novaclient Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Auth-Token: gAAAAABishRYgFjh9GWREPCU6_-CNXOwPhfAfdYRPRGTu5fOXnuNE3N2Q37eCINtLeOT8YssPciCjvW4dWEVCx2GD0EIPJm8xU3VezzLBJH0ONEwFd9HJdu-BZoelPw-Zd2PF9m8EpvWkWhsK8pzxUd37i0-iwogER2XT4hZnqJpshKELOJQMCg Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Id: None Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Domain-Name: None Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Identity-Status: Confirmed Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Is-Admin-Project: True Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Id: default Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Domain-Name: Default Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Project-Name: admin Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Role: reader,member,admin Jun 21 18:56:24.693748 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Roles: reader,member,admin Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant: admin Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-Tenant-Name: admin Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User: admin Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Id: default Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Domain-Name: Default Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: X-User-Name: admin Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: method: > Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: exception: Flavor 451 could not be found. Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: action_args: {'id': '451'} Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:24.695301 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:24.696166 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.697905 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-4f4f71c8-20d3-4495-ae5d-0b409cf5099c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103064) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:24.699131 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-4f4f71c8-20d3-4495-ae5d-0b409cf5099c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062439 Jun 21 18:56:24.699131 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 18:56:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:24.704997 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-4d9857b1-1ee5-4b2a-89ef-96313828d15d admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:24.719482 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-4d9857b1-1ee5-4b2a-89ef-96313828d15d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018092 Jun 21 18:56:24.720038 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:24.729862 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:24.743990 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017752 Jun 21 18:56:24.744538 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 18:56:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:56:24.754093 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-70b5f19d-2774-485a-bdb2-a06c0199b1bd admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:24.760168 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.wsgi [None req-70b5f19d-2774-485a-bdb2-a06c0199b1bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-70b5f19d-2774-485a-bdb2-a06c0199b1bd admin admin] Request method failure captured: Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept: application/json Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Accept-Encoding: gzip, deflate Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Connection: keep-alive Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Content-Length: 0 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Host: 10.222.0.70 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-Api-Version: compute 2.90 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Openstack-System-Scope: None Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: User-Agent: python-novaclient Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Auth-Token: gAAAAABishRYgFjh9GWREPCU6_-CNXOwPhfAfdYRPRGTu5fOXnuNE3N2Q37eCINtLeOT8YssPciCjvW4dWEVCx2GD0EIPJm8xU3VezzLBJH0ONEwFd9HJdu-BZoelPw-Zd2PF9m8EpvWkWhsK8pzxUd37i0-iwogER2XT4hZnqJpshKELOJQMCg Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Id: None Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Domain-Name: None Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Identity-Status: Confirmed Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Is-Admin-Project: True Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Id: default Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Domain-Name: Default Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Project-Name: admin Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Role: reader,member,admin Jun 21 18:56:24.761818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Roles: reader,member,admin Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc534a786d340398da9cb4c7a7e5355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc534a786d340398da9cb4c7a7e5355"}]}] Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant: admin Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Id: 8dc534a786d340398da9cb4c7a7e5355 Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-Tenant-Name: admin Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User: admin Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Id: default Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Domain-Name: Default Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Id: 8dcd62677ffc4535814a24f589fce966 Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: X-User-Name: admin Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: method: > Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: exception: Flavor 451 could not be found. Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: action_args: {'id': '451'} Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:56:24.763385 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:24.764538 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: ERROR nova.api.openstack.wsgi Jun 21 18:56:24.765945 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-70b5f19d-2774-485a-bdb2-a06c0199b1bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:56:24.767192 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-70b5f19d-2774-485a-bdb2-a06c0199b1bd admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012817 Jun 21 18:56:24.767192 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 18:56:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:56:25.591274 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:25.592777 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 21 18:56:25.593203 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:25.785781 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-2f072b75-17c7-4034-95cc-8c91d7a1e0af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:56:25.803140 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-2f072b75-17c7-4034-95cc-8c91d7a1e0af admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072149 Jun 21 18:56:25.803698 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 18:56:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:56:26.639366 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:26.640368 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 21 18:56:26.640796 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:26.832998 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-49d612f7-6f47-4dac-8577-620d01c35d28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:56:26.851796 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-49d612f7-6f47-4dac-8577-620d01c35d28 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071486 Jun 21 18:56:26.852281 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 18:56:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:56:27.673788 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:27.674797 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 21 18:56:27.675195 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:27.866910 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-c8ccecfa-53bb-41a3-a4c5-bbee1a681c1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:56:27.885535 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-c8ccecfa-53bb-41a3-a4c5-bbee1a681c1c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070667 Jun 21 18:56:27.886024 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 18:56:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:56:28.722994 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:28.724048 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 21 18:56:28.724456 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:28.915956 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-4dda7691-6818-4b56-826c-8b222fd4ec79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:56:28.933728 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-4dda7691-6818-4b56-826c-8b222fd4ec79 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071135 Jun 21 18:56:28.934457 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 18:56:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:56:29.757628 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:29.758666 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 21 18:56:29.759040 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 18:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:56:29.952259 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-c422b503-a250-4d2e-af7c-7bfb022c26d9 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:56:29.971204 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-c422b503-a250-4d2e-af7c-7bfb022c26d9 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071079 Jun 21 18:56:29.971688 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jun 21 18:56:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:57:16.824733 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:16.825781 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-3d12b4e3-e401-46de-8f8b-50d2f74c2c2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 21 18:57:16.826181 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:57:16.837144 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:57:16.889402 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-8b3d157e-ec4e-428d-b841-6c97a1e0bfe5 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:16.908899 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-8b3d157e-ec4e-428d-b841-6c97a1e0bfe5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076276 Jun 21 18:57:16.909709 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:57:16.933977 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-6630db72-262e-4bbb-9847-32a632cce62d admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:16.937469 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG dbcounter [-] [103064] Writing DB stats nova_api:SELECT=14 {{(pid=103064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:57:16.943122 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-6630db72-262e-4bbb-9847-32a632cce62d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012825 Jun 21 18:57:16.943676 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:57:16.955320 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-1f5b7cc2-5b0b-4236-ae8d-c02dfb7ef7d0 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:16.963108 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-1f5b7cc2-5b0b-4236-ae8d-c02dfb7ef7d0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011391 Jun 21 18:57:16.963646 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:57:16.976119 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:16.984499 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012300 Jun 21 18:57:16.985043 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:57:16.996508 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-839ec3e0-42ad-4050-836f-3340fbda6048 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:57:17.004276 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-839ec3e0-42ad-4050-836f-3340fbda6048 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011313 Jun 21 18:57:17.004818 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jun 21 18:57:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:00:35.299111 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:35.300115 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 21 19:00:35.300523 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 19:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:00:35.449727 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_api:SELECT=6 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:00:35.584056 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:35.587066 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 19:00:35.587066 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 19:00:35.589427 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:35.590212 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:35.591621 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:35.592400 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:35.658670 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-7738d69b-0a99-4697-bad9-fbc52ef6ad0d admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.214022 Jun 21 19:00:35.659719 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 19:00:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 19:00:36.530877 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:36.531879 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 21 19:00:36.532285 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 19:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:00:36.728165 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:36.729420 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 19:00:36.729420 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 19:00:36.730674 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:36.731123 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:36.731960 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:36.732374 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:36.753521 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-954fbc2a-840d-417d-a942-87a31a256c03 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080966 Jun 21 19:00:36.754100 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 19:00:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:00:48.051876 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:48.052916 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 21 19:00:48.053365 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 37/73] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 19:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:00:48.196967 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_cell0:SELECT=4 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:00:48.197722 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_cell1:SELECT=4 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:00:48.198312 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG dbcounter [-] [103065] Writing DB stats nova_api:SELECT=8 {{(pid=103065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:00:48.249460 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:48.250621 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 19:00:48.250621 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 19:00:48.251855 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:48.252294 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:48.253120 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:48.253569 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:48.279213 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-81270821-0985-4892-bf10-43cc97ddcf3a admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087150 Jun 21 19:00:48.279692 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 37/74] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 19:00:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:00:49.127721 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: DEBUG nova.api.openstack.wsgi [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] Calling method '>' {{(pid=103064) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:49.128763 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: INFO nova.api.openstack.requestlog [None req-9d0e558a-bf62-4557-bd0e-5ae93a8279ad admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 21 19:00:49.129203 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: [pid: 103064|app: 0|req: 38/75] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 19:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:00:49.328936 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG nova.api.openstack.wsgi [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] Calling method '>' {{(pid=103065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:00:49.330225 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 19:00:49.330225 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: warnings.warn(msg) Jun 21 19:00:49.331439 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:49.331887 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:49.332684 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:00:49.333140 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: DEBUG oslo_concurrency.lockutils [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:00:49.355603 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: INFO nova.api.openstack.requestlog [None req-b7fc7f09-858c-4a5c-80eb-91148147d130 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085374 Jun 21 19:00:49.356105 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: [pid: 103065|app: 0|req: 38/76] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 19:00:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:01:45.032535 dv-cinder-846303-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 19:01:45.033376 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: Tue Jun 21 19:01:45 2022 - graceful shutdown triggered... Jun 21 19:01:45.033828 dv-cinder-846303-1-iscsi devstack@n-api.service[103065]: Gracefully killing worker 2 (pid: 103065)... Jun 21 19:01:45.034182 dv-cinder-846303-1-iscsi devstack@n-api.service[103064]: Gracefully killing worker 1 (pid: 103064)... Jun 21 19:01:46.032988 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: worker 1 buried after 1 seconds Jun 21 19:01:46.033261 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: worker 2 buried after 1 seconds Jun 21 19:01:46.033261 dv-cinder-846303-1-iscsi devstack@n-api.service[103063]: goodbye to uWSGI. Jun 21 19:01:46.034578 dv-cinder-846303-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 19:01:46.035131 dv-cinder-846303-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 19:01:46.037898 dv-cinder-846303-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 19:01:46.048808 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 19:01:46 2022] *** Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: nodename: dv-cinder-846303-1-iscsi Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: machine: x86_64 Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: clock source: unix Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: pcre jit disabled Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: detected number of CPU cores: 4 Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: current working directory: / Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: detected binary path: /usr/bin/uwsgi-core Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: your processes number limit is 47680 Jun 21 19:01:46.050852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: your memory page size is 4096 bytes Jun 21 19:01:46.051727 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: detected max file descriptor number: 2048 Jun 21 19:01:46.051727 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: lock engine: pthread robust mutexes Jun 21 19:01:46.051727 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: thunder lock: enabled Jun 21 19:01:46.051727 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 19:01:46.051727 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 19:01:46.098183 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: Python main interpreter initialized at 0x55d2d2da89c0 Jun 21 19:01:46.098183 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: python threads support enabled Jun 21 19:01:46.098183 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: your server socket listen backlog is limited to 100 connections Jun 21 19:01:46.098183 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: your mercy for graceful operations on workers is 90 seconds Jun 21 19:01:46.098652 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 19:01:46.098739 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: *** Operational MODE: preforking *** Jun 21 19:01:46.099037 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: *** uWSGI is running in multiple interpreter mode *** Jun 21 19:01:46.099037 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: spawned uWSGI master process (pid: 117595) Jun 21 19:01:46.099244 dv-cinder-846303-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 19:01:46.099945 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: spawned uWSGI worker 1 (pid: 117618, cores: 1) Jun 21 19:01:46.103852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: spawned uWSGI worker 2 (pid: 117619, cores: 1) Jun 21 19:01:46.103852 dv-cinder-846303-1-iscsi devstack@n-api.service[117595]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 19:01:46.762067 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 19:01:46.762686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 19:01:47.978406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 19:01:47.978406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: from cryptography.utils import int_from_bytes Jun 21 19:01:47.979225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 19:01:47.979225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: from cryptography.utils import int_from_bytes Jun 21 19:01:47.979385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 19:01:47.979385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: from cryptography.utils import int_from_bytes Jun 21 19:01:47.979780 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 19:01:47.979780 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: from cryptography.utils import int_from_bytes Jun 21 19:01:50.387270 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 19:01:50.388205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 19:01:50.388205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 19:01:50.388468 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 19:01:50.388615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 19:01:50.389010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.389339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 19:01:50.389944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.390093 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 19:01:50.390237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.390237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.390505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 19:01:50.390671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.390807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 19:01:50.390943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.391070 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 19:01:50.391218 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.391491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.391640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.391786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.391965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-1-iscsi {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.392943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.393566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.393726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.393886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.394795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.395090 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-1-iscsi {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.395090 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.397818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.398209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.398595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.398965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.399285 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.399543 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.399754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.399974 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.400219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.400442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.400647 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.400877 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.401134 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.401452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.402139 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.402547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.403290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.403597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.404631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.404631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.405167 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.405421 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-1-iscsi {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.405662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.405987 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.405987 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407764 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.407939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.408166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.408369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.408655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.408806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.408967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.409229 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.409457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-1-iscsi {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.409687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.409914 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.410131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.410361 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.410597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.411014 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.411260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.411502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.411725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.412545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.412769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.412769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.413235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.413473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.413709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.413920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.414075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.414233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.414719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.414946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415197 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.415970 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.416120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.416303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.417654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.417899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.418128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.418358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.418611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.418837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.419074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.419307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.419531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.419770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.420940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.421263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.421419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.421587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.421731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.421899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.422943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.423185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.423377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.423542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.423698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.423912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.424136 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.424358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.424515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.424917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.425147 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.425396 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.425623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.425840 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.426058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.426211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.426411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.426568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.427509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.428064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.428311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.428544 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.428775 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.428994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.429201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.429361 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.429530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.429689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.429875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.430097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.430334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.430553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.430767 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.430970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.431178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.431357 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.431578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.431791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432834 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.432989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.433238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.433484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.433714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.433964 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.434120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.434269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.434439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.434439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.435191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.435433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.435712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.435976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.436208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.436441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.436663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.436973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.438216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.438400 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.438643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.438876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439087 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439627 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.439930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.440080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.440228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.440389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.440542 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.440695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441457 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441610 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.441912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442533 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442852 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.442995 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.443216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.443216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.443656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.443836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.443988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.444140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.444292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.444441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.444584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.444913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.445486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.445691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.445857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446366 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446565 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.446958 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.447092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.447576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.447576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.448184 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.448473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.448615 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.448744 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.448888 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449031 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449414 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.449948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450098 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450533 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.450946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451462 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.451886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.452080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.452276 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.452481 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.452781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.452915 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453268 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453545 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.453826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.453962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.454090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.454217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.454369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.454501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.454630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.454756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.454890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.455344 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.455496 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.455633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.455763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.455890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.456025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.456162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.456299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.456435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.456570 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.456700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 19:01:50.456827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.456961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.457182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.457312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.457892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.458030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.458356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.459994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.460122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.460249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.460375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.460509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.462842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463187 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.463866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464005 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464278 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.464946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.465081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.465546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.465678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.465827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.465956 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466383 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.466917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.467052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.467181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.467308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.467464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.467789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.468113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.468260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.468411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.468654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.468802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469035 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469877 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.469877 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470256 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470256 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470523 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.470922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.471936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472203 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472203 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472871 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.472871 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.473937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.474064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.474198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.474410 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475681 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.475823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476089 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.476876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.477970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.478292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.478292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.478594 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.478930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479449 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479729 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.479867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480373 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.480885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.481862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482134 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482926 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.482926 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483818 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.483945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.484945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.485080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.485223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.485223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.485491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.485888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486424 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.486826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487071 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487344 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487481 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487481 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.487882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488516 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488516 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.488930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.489331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.489572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.489572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.489837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490513 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.490917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.491971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492241 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.492755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.493946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494073 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494723 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.494991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.495239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.495370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.495505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.495632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.495632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496138 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496561 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.496696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.497033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.497788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.497924 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.498084 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.498084 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.498696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.498837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.498837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.499497 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.499839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.499839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500790 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.500927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.501217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.501347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.501490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.501803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.501803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.502968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503368 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.503893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.504905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.505241 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.505387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.506872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507506 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.507635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.508018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.508160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.508160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.508847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509274 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.509954 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510187 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510601 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.510864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.511376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.511507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.511635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.511776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.511905 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.512868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513460 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513460 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.513910 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514255 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514706 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514706 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514960 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.514960 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.515876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516135 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516268 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.516856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.517955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.518765 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519065 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519438 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.519976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520720 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.520986 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.521068 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.521244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.521843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.521932 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522016 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522098 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522196 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522642 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.522990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523253 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.523975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524506 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.524955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525037 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525244 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525244 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525490 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.525936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526287 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526813 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.526912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527775 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.527937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528114 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528535 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.528943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529054 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529512 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.529963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530046 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530671 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.530931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531115 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.531962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532596 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532682 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532682 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.532941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533257 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533891 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.533994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.534988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535164 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535464 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535778 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.535957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.536271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.536604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.536945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537600 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537703 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.537926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538247 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.538951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.539993 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.540243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.540360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.540670 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.540782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.540993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.541367 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.541487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.541677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.541901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.542879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543532 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.543978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.544919 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.545159 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.545352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.545667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.545980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.546319 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.546440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.546628 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.546770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.546982 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.547145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.547391 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.547497 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.547712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.547821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.548854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549197 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549425 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.549846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550154 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550459 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.550819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551096 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.551973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.552997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.553904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.554971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.555939 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556040 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556336 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556870 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.556984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557210 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557849 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.557963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.558891 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559515 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.559837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560054 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560372 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.560998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561672 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.561988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.562917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563317 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.563877 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564344 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564619 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.564933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.565159 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.565265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.565482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.565602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.565804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.566172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.566392 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.566509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.566711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.566832 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567331 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567743 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.567957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.568587 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.568801 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.568913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569200 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569308 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569570 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.569894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570511 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570693 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.570797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571133 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.571967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.572275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.572586 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.572726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.572893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573579 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.573920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.574913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575148 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575471 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.575886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576108 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.576833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577408 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577557 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.577814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578028 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578127 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578529 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.578980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.579079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.579414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.579556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.579740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.579990 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580469 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.580883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581131 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.581921 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582110 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.582835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.583060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.583165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.583387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.583487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.583771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.584371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.584605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.584708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.584934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.585999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.586240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.586346 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.586575 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.586668 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.586882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587844 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.587985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588479 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588636 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.588950 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589478 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.589969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590117 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.590936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.591875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.592933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.593953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594604 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.594919 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.595864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596071 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596514 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.596842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597512 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.597918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598486 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.598892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.599931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.600997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.601973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602361 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602648 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.602936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603229 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603456 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.603871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604079 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.604822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605006 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.605971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606701 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.606911 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607222 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.607985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608475 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.608991 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.609865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610084 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610417 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.610845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611362 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.611949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.612908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.613940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.614935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615302 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615601 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.615899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616116 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616215 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616764 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.616864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617512 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.617827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618161 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.618783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619005 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.619947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620692 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.620895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.621887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622020 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622216 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622836 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.622945 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623461 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623780 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.623898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.624997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.625137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.625362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.625575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.625695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.625893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626218 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626347 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626542 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.626967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627177 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627502 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627815 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.627966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628139 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.628890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.629892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.630094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.630319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.630437 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.631972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632475 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.632889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633113 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.633854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634118 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.634963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.635960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636764 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.636864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637069 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637435 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637513 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.637980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.638956 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639054 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639280 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.639921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.640977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.641230 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.641351 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.641544 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.641673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.641894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642490 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.642913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643571 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643798 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.643903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.644992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.645122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.645342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.645600 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.645700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.645946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.646117 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.646823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.646992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.647156 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.647517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.647679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.647841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648499 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.648975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649173 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649335 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.649970 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650429 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.650930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651246 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.651739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652049 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.652856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653230 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653549 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.653716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.654019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.654171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 19:01:50.654415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.654415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.654415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.654877 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.655028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.655253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.655571 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.655892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.656217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.656554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.656876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.657211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.657751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.658075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.658411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.658741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.659061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.659398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.659727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.660045 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.660377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.660699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.661037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.661414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.661755 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.662115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.662430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.662746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.663059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.663377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.663706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.664026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.664339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.664654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.664973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.665311 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.665625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.665938 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.666249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.666565 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.666873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.667207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.667520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.667831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.668141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.668456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.668773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.669134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.669433 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.669746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.670057 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.670369 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.670707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.671046 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.671371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.671705 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.672038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.672356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.672677 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.673008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.673450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.673779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.674100 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.674443 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.674765 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.675083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.675406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.675720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.676038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.676357 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.676694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.677028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.677368 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.677728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.678055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.678391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.678716 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.679037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.679375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.679694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.680012 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.680336 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.680655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.680973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.681320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.681645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.681982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.682316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.682631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.682965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.683767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.683767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.684088 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.684321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.684611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.684936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.685279 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.685595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 19:01:50.685846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 19:01:50.716753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Registered counter for database nova_api Jun 21 19:01:50.737566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.744339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.749447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Registered counter for database nova_api Jun 21 19:01:50.770246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.777659 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.801623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.context [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfe881bf-3b81-4d90-a9e4-cd38631b724f(cell1) {{(pid=117619) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 19:01:50.805799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:01:50.807397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:01:50.808205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:01:50.810175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:01:50.812157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Registered counter for database nova_cell0 Jun 21 19:01:50.816501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Registered counter for database nova_cell1 Jun 21 19:01:50.824491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.825927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.832583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.834480 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.835147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.context [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfe881bf-3b81-4d90-a9e4-cd38631b724f(cell1) {{(pid=117618) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 19:01:50.839301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:01:50.840925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:01:50.841786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:01:50.843746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:01:50.845772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Registered counter for database nova_cell0 Jun 21 19:01:50.850040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Registered counter for database nova_cell1 Jun 21 19:01:50.857517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.858805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.865594 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.866966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:50.984626 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO dbcounter [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Registered counter for database nova_cell0 Jun 21 19:01:50.992401 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:50.998623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writer thread running {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:51.021918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO dbcounter [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Registered counter for database nova_cell0 Jun 21 19:01:51.028772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_db.sqlalchemy.engines [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 19:01:51.033851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writer thread running {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 19:01:51.325846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 19:01:51.333803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 19:01:51.355595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 19:01:51.362990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 19:01:51.680864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 19:01:51.687925 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: WARNING keystonemiddleware.auth_token [None req-bfd183b2-c787-452e-a00e-c0911fbaa115 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 19:01:51.693844 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2d2da89c0 pid: 117619 (default app) Jun 21 19:01:51.709976 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 19:01:51.716085 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: WARNING keystonemiddleware.auth_token [None req-7866adc7-679f-4c5e-b340-74d061efb4e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 19:01:51.721756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2d2da89c0 pid: 117618 (default app) Jun 21 19:02:35.494633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-07fabda7-0995-407e-90b0-14902cae169c tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f3597912280>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:35.528534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:35.529624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:35.531249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:35.532266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:37.958578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-07fabda7-0995-407e-90b0-14902cae169c tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/b8243697-7f9d-4485-be77-a74803cbdae6" status: 200 len: 351 microversion: 2.1 time: 2.841006 Jun 21 19:02:37.960490 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 1/1] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:02:35 2022] GET /compute/v2.1/os-volumes/b8243697-7f9d-4485-be77-a74803cbdae6 => generated 351 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:02:40.424670 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8a9d68d3-daae-4d6a-80de-be75c4c5b888 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f3597916280>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:40.455099 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:40.456982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:40.458266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:40.459272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:02:41.423719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8a9d68d3-daae-4d6a-80de-be75c4c5b888 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/016a238c-9d10-4674-90ac-512fcff1750c" status: 200 len: 351 microversion: 2.1 time: 1.272390 Jun 21 19:02:41.430309 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:02:40 2022] GET /compute/v2.1/os-volumes/016a238c-9d10-4674-90ac-512fcff1750c => generated 351 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:02:44.105675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-381dc2cd-20c5-4a33-8f0a-0557b874040e tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f359776a550>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:44.198763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-381dc2cd-20c5-4a33-8f0a-0557b874040e tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0b6ae198-3053-4c9c-b713-9848445000e8" status: 200 len: 350 microversion: 2.1 time: 0.097977 Jun 21 19:02:44.199336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:02:44 2022] GET /compute/v2.1/os-volumes/0b6ae198-3053-4c9c-b713-9848445000e8 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:02:44.211999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf8bf22c-e604-495b-8e8c-524e0c4f6d14 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f359776a280>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:44.449974 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf8bf22c-e604-495b-8e8c-524e0c4f6d14 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.242846 Jun 21 19:02:44.450860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jun 21 19:02:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:02:44.463150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-107902cd-1bd5-465a-91e0-e2f601ee995b tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f359776a700>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:44.658380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-107902cd-1bd5-465a-91e0-e2f601ee995b tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.199042 Jun 21 19:02:44.659263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1148 bytes} [Tue Jun 21 19:02:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:02:44.676555 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bb14af9d-3f69-4d6b-aef2-3de504a4a146 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f359776ad30>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:44.992586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bb14af9d-3f69-4d6b-aef2-3de504a4a146 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.320789 Jun 21 19:02:44.993427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jun 21 19:02:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:02:45.009709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d3685712-e0f3-4cc3-b2c7-1cb0862101b9 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f3597734160>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:45.195984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d3685712-e0f3-4cc3-b2c7-1cb0862101b9 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.190187 Jun 21 19:02:45.208179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1166 bytes} [Tue Jun 21 19:02:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:02:45.213129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-97abf9ba-c711-46ce-8ab0-1fda18e5ca54 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f35977339d0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:45.391077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-97abf9ba-c711-46ce-8ab0-1fda18e5ca54 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.181948 Jun 21 19:02:45.391656 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jun 21 19:02:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:02:45.408093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1302c809-e0b4-460a-b143-d65fdafa22dc tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f359776adc0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:45.575209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1302c809-e0b4-460a-b143-d65fdafa22dc tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.170858 Jun 21 19:02:45.575785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 5/9] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jun 21 19:02:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:02:45.591154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d0930958-23ca-45ca-b46f-6d79353b2c33 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f3597733790>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:45.838062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d0930958-23ca-45ca-b46f-6d79353b2c33 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.250941 Jun 21 19:02:45.839221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 5/10] 10.222.0.70 () {58 vars in 1187 bytes} [Tue Jun 21 19:02:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:02:45.860726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bf5a8ebb-927e-40cd-8363-8d92b38f7a23 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] Calling method '.version_select at 0x7f3597734940>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:46.201119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bf5a8ebb-927e-40cd-8363-8d92b38f7a23 tempest-VolumesTestJSON-159820362 tempest-VolumesTestJSON-159820362-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.345464 Jun 21 19:02:46.204314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jun 21 19:02:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:02:52.523502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a83a7eee-d759-43b5-8ec7-cc84c641b544 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: .version_select at 0x7f359808baf0>, body: {"keypair": {"name": "tempest-keypair-681063432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW0VxE0Zzf6GCeAv5/GeiFb76oTeJpmz1dc3Z0+0MgpoWeI0o4bMbMbrUy0jaawKgLoaC7JKVdlk+EbE0CArpr+xk4iCuQ4Cvvvsap/7stprEiNf/X4mh/eIP8e3iCZzQ=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:02:52.630822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-a83a7eee-d759-43b5-8ec7-cc84c641b544 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:02:52.653212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-a83a7eee-d759-43b5-8ec7-cc84c641b544 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for user b6ce650c0ae6494ab895644347bbb5b7 and project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:02:52.764690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a83a7eee-d759-43b5-8ec7-cc84c641b544 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.400672 Jun 21 19:02:52.774234 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 6/12] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jun 21 19:02:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 19:02:53.242732 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e727b658-f007-4d08-b049-98f2d634db6b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: .version_select at 0x7f359776a790>, body: {"keypair": {"name": "tempest-keypair-80664351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJgkdSJozyKoxyP9MjBol6P7pBhsctiTBifCjD5XXWys6geYHSgGRo59BytepOJyv7bDBDlOpWdK0QrkZDBPenYDRFAyNwlkdeF+aelGhOwtltLxCDQxbHRewXtOq4A5A=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:02:53.328147 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e727b658-f007-4d08-b049-98f2d634db6b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:02:53.345043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e727b658-f007-4d08-b049-98f2d634db6b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for user 2b973f8f63eb49f19895a43313f2bc55 and project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:02:53.456000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e727b658-f007-4d08-b049-98f2d634db6b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.388783 Jun 21 19:02:53.465721 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 7/13] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:02:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:02:55.804824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-530411017", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:02:56.014564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] validate_networks() for [('5a8eeb6c-3369-45e7-8289-8683fe906e2b', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:02:57.389855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1263421237", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "networks": [{"uuid": "0c961e3a-9ef6-4fa5-953c-625de340114a"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:02:57.518683 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] validate_networks() for [('0c961e3a-9ef6-4fa5-953c-625de340114a', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:02:58.625730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:02:58.627117 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:02:58.627763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:02:58.628913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:02:58.629529 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:02:58.642634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:02:58.643576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:02:58.644682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:02:58.645345 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:02:58.689290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:02:58.694624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for user eeafe22d22f648d6aefcc6a308d4fc0d and project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:02:58.708423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:02:58.711558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:02:58.813701 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9e64db40-32e9-45cc-918b-ff4a90e6d07f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.146919 Jun 21 19:02:58.816872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 7/14] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:02:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:02:58.831751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1631612848", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28dfca6-c8cd-489e-b796-006f3a518cdc"}], "security_groups": [{"name": "tempest-securitygroup--863436224"}], "key_name": "tempest-keypair-80664351", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:02:59.264535 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:02:59.265418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:02:59.265554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:02:59.266480 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:02:59.266972 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:02:59.285666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] validate_networks() for [('c28dfca6-c8cd-489e-b796-006f3a518cdc', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:02:59.299337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:02:59.300329 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:02:59.307537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:02:59.308293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:02:59.380291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Getting quotas for project d22f07bc3f5641d19b56a56257d0c951. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:02:59.390811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Getting quotas for user a7ee05285e124183a43f5757fd94ec40 and project d22f07bc3f5641d19b56a56257d0c951. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:02:59.425781 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:02:59.433068 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:02:59.580937 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-90440ebd-7f48-4ffe-a1da-8f2acb2c1bfe tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.314194 Jun 21 19:02:59.582157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 8/15] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:02:59.595912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b8e34c09-167b-4687-ba93-1d0a9364d9ea tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:02:59.597643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b8e34c09-167b-4687-ba93-1d0a9364d9ea tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:02:59.880128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b8e34c09-167b-4687-ba93-1d0a9364d9ea tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:02:59.907302 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b8e34c09-167b-4687-ba93-1d0a9364d9ea tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1221 microversion: 2.1 time: 0.323430 Jun 21 19:02:59.911054 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:02:59 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:02:59.938521 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-752532241", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c4d315c-7943-4b0e-9c96-174194be76a6"}], "security_groups": [{"name": "tempest-securitygroup--371926612"}], "key_name": "tempest-keypair-681063432", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:00.661768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] validate_networks() for [('2c4d315c-7943-4b0e-9c96-174194be76a6', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:03:01.208920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:03:01.209475 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:03:01.210190 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:03:01.210726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:03:01.211252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:03:01.226079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:01.228137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:01.229464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:01.243319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:01.342568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:03:01.347668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for user 2b973f8f63eb49f19895a43313f2bc55 and project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:03:01.383445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:03:01.386092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:03:01.472420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e4c98e15-bc5e-4f46-b18a-8bddb9ed7db9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.653429 Jun 21 19:03:01.473502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 8/17] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:02:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:03:01.481575 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-939fa657-54fc-405d-947e-77c9b2f4c6ff tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:01.483452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-939fa657-54fc-405d-947e-77c9b2f4c6ff tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:01.750027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-939fa657-54fc-405d-947e-77c9b2f4c6ff tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:01.816802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-939fa657-54fc-405d-947e-77c9b2f4c6ff tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1215 microversion: 2.1 time: 0.338487 Jun 21 19:03:01.819165 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 9/18] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:01 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:01.849864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1255718448", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:02.033442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] validate_networks() for [('5a8eeb6c-3369-45e7-8289-8683fe906e2b', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:03:02.196166 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:03:02.196720 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:03:02.197422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:03:02.197846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:03:02.198436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:03:02.222392 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:02.224025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:02.224874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:02.225347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:02.256721 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:03:02.263812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for user b6ce650c0ae6494ab895644347bbb5b7 and project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:03:02.326927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:03:02.335624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:03:02.554432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7865aad4-502e-4731-97a5-f9b6af8567fe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.640428 Jun 21 19:03:02.555100 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 10/19] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jun 21 19:02:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 19:03:02.597273 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f88254ae-2292-4594-8208-9cc827da758b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:02.599550 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f88254ae-2292-4594-8208-9cc827da758b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:02.900355 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f88254ae-2292-4594-8208-9cc827da758b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:02.907786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f88254ae-2292-4594-8208-9cc827da758b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1236 microversion: 2.1 time: 0.337047 Jun 21 19:03:02.908375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 11/20] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:02 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1236 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:02.948605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:02.949279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:03.428659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:03.476783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:03.489412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:03.502668 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cc4c065f-4c82-4643-b81d-c510f1da773e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1280 microversion: 2.20 time: 0.587301 Jun 21 19:03:03.509636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 12/21] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:02 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1280 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:03.541637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:03.551328 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:03.593964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:03.595180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:03.597017 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:03.597691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:03.974124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:03:03.976114 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:03:03.977550 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:03:03.978604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:03:03.979580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:03:04.056871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.056871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.056871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.056871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.141831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:03:04.147463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for user eeafe22d22f648d6aefcc6a308d4fc0d and project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:03:04.165315 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:03:04.168002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:03:04.301538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e7571921-145e-47c5-9a5a-d6890b20846d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.475652 Jun 21 19:03:04.302219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 10/22] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:03:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:03:04.322354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:04.336349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:04.336989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:04.365403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.366262 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.368939 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.370855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.418492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a3df3ba-2325-4742-97c7-2193a4878247 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1267 microversion: 2.1 time: 0.903532 Jun 21 19:03:04.419934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 13/23] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:03 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1267 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:04.447703 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ad64b35a-7c70-4943-a55d-5ea88d32980a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:04.448961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ad64b35a-7c70-4943-a55d-5ea88d32980a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:04.724854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ad64b35a-7c70-4943-a55d-5ea88d32980a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:04.740004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ad64b35a-7c70-4943-a55d-5ea88d32980a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1222 microversion: 2.1 time: 0.316761 Jun 21 19:03:04.741862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 14/24] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:04 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1222 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:04.756525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:04.767282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:04.806312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.807690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.809564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:04.813918 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:04.962521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:05.014470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4a13185e-6a2c-4a18-8953-8c4a94eabf8d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1288 microversion: 2.1 time: 0.705171 Jun 21 19:03:05.023817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 11/25] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:04 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1288 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:05.438576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:05.439210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:05.446314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:05.464323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:05.465858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:05.468103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:05.469064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:05.503217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:05.529540 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:05.531213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3249f409-6568-4fbf-b972-b2906f9f7ed6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1276 microversion: 2.20 time: 0.787482 Jun 21 19:03:05.532012 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 15/26] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:04 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1276 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:05.771058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:05.772199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:05.840454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:05.856541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:05.858074 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:05.858881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:05.951240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:05.967349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fe56caa8-bac4-4394-b592-06c93d2631c1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1273 microversion: 2.1 time: 0.533325 Jun 21 19:03:05.993546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 12/27] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:05 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1273 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:06.050562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:06.051553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:06.076649 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:06.078403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:06.083913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:06.084419 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:06.677150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:06.710461 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7941830b-832a-4ddd-bd38-6c384fb257c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1226 microversion: 2.1 time: 0.947333 Jun 21 19:03:06.714886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 16/28] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:05 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1226 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:06.734721 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:06.734721 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:06.764786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:06.765652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:06.767616 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:06.771695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:06.838811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:06.849899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e2c1439b-aacc-4c38-ad3b-019771728c30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1306 microversion: 2.1 time: 0.806519 Jun 21 19:03:06.865647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 13/29] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:06 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1306 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:06.995073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:06.998749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:07.028487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.028939 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.030569 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.032911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.151789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:07.173191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:07.183711 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:07.185034 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c325b77d-0a44-491f-9838-d8a7ba91c8f7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1338 microversion: 2.20 time: 0.468613 Jun 21 19:03:07.204981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 17/30] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:06 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1338 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:07.371248 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:07.380908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3e2714a5-cec9-4ab6-9eb0-d890d254fcbd tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1273 microversion: 2.1 time: 0.399251 Jun 21 19:03:07.413554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 14/31] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:06 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1273 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:07.741727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:07.743226 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:07.757663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.758685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.759782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.762695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.879625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:07.883817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:07.914427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.925703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.926622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:07.934922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:07.935719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:07.938463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-52476f86-7069-408d-bd85-d18573f5dcb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1280 microversion: 2.1 time: 0.201122 Jun 21 19:03:07.943592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 18/32] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:07 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:08.213885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:08.215327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:08.250368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:08.253470 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:08.260119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:08.264514 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:08.590476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:08.607966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0c8c81d3-8c0b-4cc9-a3e0-23f84aaf384e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1294 microversion: 2.1 time: 0.735926 Jun 21 19:03:08.608657 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 15/33] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:07 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1294 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:08.623826 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:08.627083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:08.645888 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:08.646462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:08.653164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:08.654962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:08.805254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:08.834440 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:08.839741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:08.863214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-97a2e7b6-1453-45e8-9e9d-e89fd20ff473 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1338 microversion: 2.20 time: 0.635675 Jun 21 19:03:08.884338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 19/34] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:08 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1338 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:08.966632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:08.981374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:09.030734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:09.031190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:09.031981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:09.032425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:10.107949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:10.182765 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dcbefdc7-97b7-47a9-833d-8a3ae50c9fcf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1280 microversion: 2.1 time: 1.214805 Jun 21 19:03:10.186651 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 20/35] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:08 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1280 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:10.242009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:10.253883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:10.309269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:10.340567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:10.340567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:10.340567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:10.754540 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:10.777255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-42c108bc-3a04-4009-a40b-a8f17352831e tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 2.166240 Jun 21 19:03:10.782467 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 16/36] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:08 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:10.807489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:10.810022 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:10.840719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:10.848306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:10.869044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:10.869044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:10.985841 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:11.003045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b7a58936-aa76-45b4-b82e-817894cd7bb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1294 microversion: 2.1 time: 0.808561 Jun 21 19:03:11.016548 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 21/37] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:10 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1294 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:11.208910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:11.210158 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:11.243563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:11.243563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:11.244433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:11.245382 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:11.900144 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:11.956251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:11.992679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:11.997655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d02b167e-3055-4f3d-ba26-35fc57eeff1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1338 microversion: 2.20 time: 1.213245 Jun 21 19:03:12.025221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 17/38] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:10 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1338 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:12.057451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:12.058834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:12.067365 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:12.079578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:12.082061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:12.083145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:12.085853 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5cfe95b7-f715-4a4d-b525-4a5729c251dc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1280 microversion: 2.1 time: 0.882611 Jun 21 19:03:12.087217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:12.099757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 22/39] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:11 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1280 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:12.107480 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:12.108108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:12.166559 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:12.170186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:12.177260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:12.181004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:12.287839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:12.932648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:12.979030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-435ddb3e-d849-41e8-80f2-0f1469f7ece5 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1294 microversion: 2.1 time: 0.877761 Jun 21 19:03:13.000360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 23/40] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:12 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1294 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:13.042614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:13.043533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:13.086943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:13.100445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:13.103107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:13.108216 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:14.117961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:14.160341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=24 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:14.734586 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=24 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:15.342455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:15.381835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7f462541-b4c9-437b-bfdc-8d16ac03a19c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 3.346093 Jun 21 19:03:15.388931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 18/41] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:12 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 3363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:15.395126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:15.400857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:15.426085 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:15.426838 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:15.430830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:15.431677 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:16.532179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:16.551672 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:16.567417 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:16.568773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a3fa4332-7850-4a61-8d03-fad197c2c01c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 3.534773 Jun 21 19:03:16.569409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 24/42] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:13 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 3536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:16.598684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:16.599368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:16.636079 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:16.652675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:16.652988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:16.660563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:16.661035 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:20.197655 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:20.235998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-614e3c54-bf68-4a36-abb2-2f99cc41f730 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 3.656134 Jun 21 19:03:20.241825 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 25/43] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:16 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 3665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:20.288050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:20.296657 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:20.326802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:20.327987 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:20.331202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:20.332242 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:20.727047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:20.819835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9eb0e871-87d7-4535-a30c-7478ef387e8d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 5.427134 Jun 21 19:03:20.821495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 19/44] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:15 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 5431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:20.857209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:20.865574 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:20.896414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:20.897799 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:20.899461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:20.902030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:21.801006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:21.820784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1554a036-d166-445b-a4bb-7cd60457e2b0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 1.576558 Jun 21 19:03:21.821473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 26/45] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:20 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:21.843237 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:21.859854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:21.865891 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:21.868404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-92155aee-1784-471f-8b12-10bf781cddb0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 1.037418 Jun 21 19:03:21.870565 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 20/46] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:20 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:21.879972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:21.881539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:21.894041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:21.895063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:21.896682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:21.897805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.244759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-bc522437-dc6c-489f-b938-c8d4cf7e97f7 req-3d15017c-f788-403e-b625-481f32af4fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7f6d1d-7ba9-4962-855a-d2eea1afe621", "tag": "c5bd35da-4108-4e3e-817f-511997259ea0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:22.259396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-bc522437-dc6c-489f-b938-c8d4cf7e97f7 req-3d15017c-f788-403e-b625-481f32af4fe8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:22.260306 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-bc522437-dc6c-489f-b938-c8d4cf7e97f7 req-3d15017c-f788-403e-b625-481f32af4fe8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.294454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-bc522437-dc6c-489f-b938-c8d4cf7e97f7 req-3d15017c-f788-403e-b625-481f32af4fe8 service nova] Creating event network-changed:c5bd35da-4108-4e3e-817f-511997259ea0 for instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 on hv-cinder-84630 Jun 21 19:03:22.297412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-bc522437-dc6c-489f-b938-c8d4cf7e97f7 req-3d15017c-f788-403e-b625-481f32af4fe8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117619) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 19:03:22.301243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:22.302566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.306091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:22.308676 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.337884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.compute.rpcapi [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 19:03:22.341734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] Releasing lock "compute-rpcapi-router" {{(pid=117619) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 19:03:22.427700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-66232334-05a7-49fa-ac9b-758f8f783adf None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.604622 Jun 21 19:03:22.428441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 27/47] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:22.434418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:22.435186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:22.468428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:22.473703 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.477791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:22.481637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:22.615898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:22.619352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=71 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:22.641542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-16c80bf2-419d-4123-b59c-0a2d185ea3a8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.768420 Jun 21 19:03:22.644562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 21/48] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:21 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:23.041814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d84eb7c7-53cb-4a19-80c1-9a1ede36bdaa req-821db509-16bf-4bfe-8ac7-fa3bbe9b8ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a342ffaa-5a3b-44f2-8bd6-309d7768b588", "tag": "dec56129-7c7f-479b-a8a4-27f8c5ef76c0"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:23.045455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:23.076143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d84eb7c7-53cb-4a19-80c1-9a1ede36bdaa req-821db509-16bf-4bfe-8ac7-fa3bbe9b8ac6 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.079200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d84eb7c7-53cb-4a19-80c1-9a1ede36bdaa req-821db509-16bf-4bfe-8ac7-fa3bbe9b8ac6 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.112778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d84eb7c7-53cb-4a19-80c1-9a1ede36bdaa req-821db509-16bf-4bfe-8ac7-fa3bbe9b8ac6 service nova] Creating event network-changed:dec56129-7c7f-479b-a8a4-27f8c5ef76c0 for instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 on hv-cinder-84630 Jun 21 19:03:23.114258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d84eb7c7-53cb-4a19-80c1-9a1ede36bdaa req-821db509-16bf-4bfe-8ac7-fa3bbe9b8ac6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 19:03:23.115916 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.116573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.117625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.120113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.122025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:23.131318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.compute.rpcapi [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 19:03:23.132301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] Releasing lock "compute-rpcapi-router" {{(pid=117618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 19:03:23.150591 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a5713dec-a562-4ac7-97db-03c75633db50 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.716613 Jun 21 19:03:23.151509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 28/49] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:22 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:23.159981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:23.160593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:23.164795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-28fad353-dac8-4e35-99ce-aae0192977bb None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389407 Jun 21 19:03:23.166718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 22/50] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:23.172177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:23.172887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:23.174853 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.175935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.178737 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.180771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.191346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.191820 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.192611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.193057 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.874406 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:23.900568 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9766d0b2-9648-4d75-a1a3-a9df8428e4ec tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.745025 Jun 21 19:03:23.912196 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 29/51] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:23 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:23.923430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:23.926259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:23.936703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:23.943357 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.943939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.948758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:23.949556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:23.951447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:23.961212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:23.967264 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-169ac1fe-4f97-4cd1-a931-d11ea858bbbf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.794567 Jun 21 19:03:23.968131 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 23/52] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:23 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:23.975756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:24.170696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:24.172271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:24.206060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:24.206519 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:24.207315 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:24.207754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:24.291295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:24.301625 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5653af49-6e3d-44e0-ae8b-3c9f69e9a8b2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.385443 Jun 21 19:03:24.302697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 30/53] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:23 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:24.476257 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-01b0c95a-a5e1-47da-81e4-67b4a6a1b801 req-183b8a46-eab1-4f98-944d-cec1c3b69034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:24.495925 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01b0c95a-a5e1-47da-81e4-67b4a6a1b801 req-183b8a46-eab1-4f98-944d-cec1c3b69034 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:24.497039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01b0c95a-a5e1-47da-81e4-67b4a6a1b801 req-183b8a46-eab1-4f98-944d-cec1c3b69034 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:24.526462 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-01b0c95a-a5e1-47da-81e4-67b4a6a1b801 req-183b8a46-eab1-4f98-944d-cec1c3b69034 service nova] Creating event network-changed:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:03:24.541063 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-01b0c95a-a5e1-47da-81e4-67b4a6a1b801 req-183b8a46-eab1-4f98-944d-cec1c3b69034 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071962 Jun 21 19:03:24.542759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 31/54] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:24.563181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:24.603104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bdc68b8a-8e4d-40d2-af40-3a5e00bbe2bf tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.438277 Jun 21 19:03:24.604158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 24/55] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:24 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:24.922352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:24.923060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:24.940409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:24.941221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:24.947369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:24.948681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:24.990624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:24.992123 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:25.014335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.015102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.016517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.017335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.255486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.270429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-163f87db-7158-444f-93e6-5e65e6f24ddc tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.352159 Jun 21 19:03:25.271017 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 32/56] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:24 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:25.275903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b", "tag": "c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7"}, {"name": "network-changed", "server_uuid": "9c71b4bb-1be3-4662-aa0b-78d6acfa27ff", "tag": "ec0ef0ca-8788-4f95-bf71-f3ce17595dce"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:25.303293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.304500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.333170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] Creating event network-changed:c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7 for instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b on hv-cinder-84630 Jun 21 19:03:25.334022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] Creating event network-changed:ec0ef0ca-8788-4f95-bf71-f3ce17595dce for instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff on hv-cinder-84630 Jun 21 19:03:25.347138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-4934f47d-ec2f-4e77-8fa9-bbcd5b9639bd req-ff08bccc-3875-48d2-a21d-bbfc71566703 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074697 Jun 21 19:03:25.353474 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 33/57] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:25.361189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:25.362011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:25.379862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.384287 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.384834 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.385783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.386486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.390813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.392364 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.394124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d0d4f3cd-4540-4677-9acc-0236be493c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.411114 Jun 21 19:03:25.397138 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 25/58] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:24 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:25.565127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.575340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3ba8c649-7720-4bbd-b014-6e96baaf8842 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.220182 Jun 21 19:03:25.576811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 34/59] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:25 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:25.640664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:25.641551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:25.650448 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.651662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.652818 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:25.654873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:25.946580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:25.972952 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c828a71b-e03b-44d9-a8f4-52a7fec6b584 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.343772 Jun 21 19:03:25.973981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 26/60] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:25 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:26.288779 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:26.289465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:26.296489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.296947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.297978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.299013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.422801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:26.427227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:26.437991 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.438776 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.440001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.441083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.532325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:26.546444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-82a485fd-3eed-498a-900f-2ab1aedaed00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.261280 Jun 21 19:03:26.547889 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 35/61] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:26 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:26.594346 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:26.595315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:26.603791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.604522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.606303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:26.606790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:26.650807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:26.659748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:26.661606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:26.662967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bc973514-e6a9-4851-83e8-0444bd287c22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.246373 Jun 21 19:03:26.664007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 27/62] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:26 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:26.829982 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:26.838640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0dd90e22-8fb7-47b8-a9fb-e505087fdfb4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.248292 Jun 21 19:03:26.839609 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 36/63] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:26 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:26.999708 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:27.000496 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:27.012756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.013067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.014018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.017035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.232307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:27.270293 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9a8a1d40-bdff-413c-bbf3-03ccbfdf5fac tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.269087 Jun 21 19:03:27.271733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 28/64] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:26 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:27.571130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:27.572418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:27.585315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.586077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.587391 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.588175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.694236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:27.695170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:27.703576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.704446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.706134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.706925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.832043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:27.842177 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d83e5d2d-17af-4aa4-976f-cd3d61c13201 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.279532 Jun 21 19:03:27.843095 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 37/65] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:27 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:27.873125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:27.874555 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:27.886857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.896375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.898743 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:27.900973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:27.973178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:27.988044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:27.992394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:27.995389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8fbe6296-a8ec-4988-8bea-04b9ff5affcb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.307691 Jun 21 19:03:27.998302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 29/66] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:27 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:28.111190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:28.121350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b7452289-a495-4f65-9093-38714c3ac353 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.261362 Jun 21 19:03:28.123376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 38/67] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:27 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:28.287843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:28.288489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:28.297130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:28.297277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:28.297984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:28.298830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:28.500686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:28.511586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-355deb42-cb2f-43b7-bdaa-f8e5250438b8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.227459 Jun 21 19:03:28.512653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 30/68] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:28 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:28.862997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:28.865027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:28.875371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:28.876544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:28.878745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:28.879829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.029008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:29.031140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:29.041894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.045320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.053452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.054479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.273905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:29.291404 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da095064-8a05-4f44-a269-44c7f18a848b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.434398 Jun 21 19:03:29.292856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 39/69] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:28 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:29.305742 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:29.309584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:29.325958 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.327030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.328928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.333590 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.433952 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:29.452379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:29.457807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:29.461039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-841153a3-bfe4-46ca-a319-2e9e98693189 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.439408 Jun 21 19:03:29.464934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 31/70] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:29 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:29.558646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:29.564608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:29.612784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.616446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.623034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:29.626282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:29.793383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:29.811544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-25eeabcb-9c83-4e28-b9d3-65fdd12e34be tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.516133 Jun 21 19:03:29.812133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 40/71] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:29 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:30.328095 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:30.330556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:30.347911 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.348883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:30.350702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.351546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:30.620843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:30.634952 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-103e885b-8f56-4598-8dd7-3c68410c67fd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 1.106782 Jun 21 19:03:30.635856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 32/72] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:29 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:30.650633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:30.651474 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:30.663348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.663797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:30.665283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.665774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:30.701670 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:30.714307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a3912b6b-d901-4ae0-9c30-fbe1876fac98 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.392402 Jun 21 19:03:30.719089 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 41/73] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:30 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:30.831586 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:30.832217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:30.839874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.840832 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:30.842646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:30.843305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:31.014359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:31.030862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:31.034396 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:31.035842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f111bc82-03b1-456e-8c3f-12dfbf0982f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.398385 Jun 21 19:03:31.036422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 33/74] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:30 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:31.068348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:31.078226 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1c5df033-a391-4b16-bdd4-08f653c758e8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.251873 Jun 21 19:03:31.088841 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 42/75] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:30 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:31.658205 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:31.661079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:31.675221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:31.676461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:31.677890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:31.681249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:31.733630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:31.735249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:31.746354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:31.749046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:31.755701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:31.756539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:32.125456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.134246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-be07d545-a03c-49a1-99d7-e6395bace3eb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.483382 Jun 21 19:03:32.136605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 34/76] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:31 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:32.141605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:32.144521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:32.163797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:32.164453 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:32.167315 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:32.168015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:32.279491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.288415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-761ea4c9-5c5a-4320-85e5-b01284bd010f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.559974 Jun 21 19:03:32.292612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 43/77] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:31 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:32.302386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:32.303298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:32.334912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:32.336922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:32.337435 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:32.338229 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:32.338669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:32.520401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.533503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.535683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.537225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b1337e6a-6d2a-458f-8502-c6359f57a8df tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.399227 Jun 21 19:03:32.543280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 35/78] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:32 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:32.667630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:32.678306 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ade367cf-94cf-400b-b706-dbb15051d980 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.384792 Jun 21 19:03:32.690520 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 44/79] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:32 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:33.163778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:33.168341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:33.181320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:33.184475 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:33.185514 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:33.187312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:33.188142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:33.319336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:33.323634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:33.350013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:33.351187 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:33.353458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:33.367045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:34.075388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.091902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7a400923-00bb-41e5-a0e3-7a66e99aa037 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.937931 Jun 21 19:03:34.092553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 36/80] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:33 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:34.098084 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:34.099179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:34.113280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:34.115626 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:34.118941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:34.119616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:34.244188 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.264072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-89ab41b3-69b6-49d9-82fe-a3b6c40a278c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.954416 Jun 21 19:03:34.266402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 45/81] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:33 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:34.286380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:34.287921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:34.298532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:34.300375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:34.302201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:34.303152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:34.469596 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.484113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.486082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.487411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3fae2df2-259e-46c8-ba50-121beb4983d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.393495 Jun 21 19:03:34.488602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 37/82] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:34 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:34.551860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:34.565295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d5e0db45-46d6-4946-8865-6f0a956d38d9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.286991 Jun 21 19:03:34.566465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 46/83] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:34 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:35.118974 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:35.120298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:35.131817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.132536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.134002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.134725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.300473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:35.303638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:35.316072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.316840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.318558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.319275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.388389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.390996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:35.399791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9e9ff590-65af-4fc5-a20a-ea9faa2d5a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.287404 Jun 21 19:03:35.400694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 38/84] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:35 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:35.515934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.519706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:35.520652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:35.524348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1a85a008-845c-4bec-8687-f1326e724f32 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.245709 Jun 21 19:03:35.525012 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 47/85] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:35 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:35.536277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.536745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.537583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.538047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.594849 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:35.596280 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:35.617422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.618482 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.620106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:35.620881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:35.635838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:35.795432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.814487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.830206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.834219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ce9f61e0-80db-41e6-b2cc-3982605da169 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.326505 Jun 21 19:03:35.835611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 39/86] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:35 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:35.893477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:35.902124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-660ce4c2-143f-4989-a211-27c3332758af tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.314579 Jun 21 19:03:35.903197 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 48/87] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:35 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:36.421521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:36.422842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:36.432245 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.433206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.434513 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.435399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.545694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:36.547241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:36.566377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.567270 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.569223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.570231 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.677335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:36.689873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c524d99a-24f2-4634-a351-e18bb47a9af2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.274699 Jun 21 19:03:36.700089 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 40/88] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:36 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:36.787176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:36.803158 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5d54fd89-9bda-4b69-b6d6-eb1ca99fe892 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.264411 Jun 21 19:03:36.804526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 49/89] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:36 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:36.852785 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:36.853445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:36.861389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.861808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.862604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.863041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.921169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:36.921953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:36.929817 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.930523 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:36.931519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:36.932117 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:37.127640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:37.155557 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:37.160951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:37.163256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-881977e4-06eb-4a9e-af51-894f2eb9f2fc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.314418 Jun 21 19:03:37.165050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 41/90] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:36 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:37.207307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:37.224325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f7cb93bb-23f7-44cd-8aea-51a4fd14c74e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.307451 Jun 21 19:03:37.225489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 50/91] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:36 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:37.712436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:37.713544 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:37.728474 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:37.729255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:37.730551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:37.731274 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:37.827225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:37.829039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:37.846902 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:37.847799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:37.849264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:37.850026 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:38.032476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.080483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72b7a13e-b8ce-4089-b38c-61d3226bf0ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.371759 Jun 21 19:03:38.082648 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 42/92] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:37 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:38.102645 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.112611 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7c46b417-3ad1-4834-9c0e-010220c2d76c tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.292804 Jun 21 19:03:38.113493 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 51/93] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:37 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:38.203502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:38.214489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:38.240622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:38.244793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:38.254626 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:38.255742 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:38.266879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:38.268211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:38.293913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:38.302277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:38.303709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:38.304484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:38.740679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.746260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.757855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bb8fe25e-e621-40c2-8161-b151d9f2624f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.510651 Jun 21 19:03:38.769019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 52/94] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:38 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:38.771867 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.780258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:38.782690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-218b06c2-2754-41c1-96b2-1d46e2388e46 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.587168 Jun 21 19:03:38.783491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 43/95] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:38 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:39.101486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:39.102568 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:39.112638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.113603 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.115226 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.116044 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.140438 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:39.141906 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:39.151632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.152375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.156985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.157892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.514489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:39.529685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f8eab23e-47b0-448c-983f-1bc06c755c20 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.394459 Jun 21 19:03:39.531143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 44/96] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:39 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:39.569631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:39.588757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-453428db-59cf-4a91-86d3-ca7ae4c8f309 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.493747 Jun 21 19:03:39.600944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 53/97] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:39 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:39.779625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:39.781136 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:39.795149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.796545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.799110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.800776 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.814251 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:39.815336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:39.826368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.827106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:39.828443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:39.829244 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:40.720098 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:40.746169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a3526254-3de6-45b8-a12e-24e4c8c95be0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.972656 Jun 21 19:03:40.750329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 45/98] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:39 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:40.770801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:40.772468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:40.781350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:40.788717 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:40.790439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:40.791971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:40.792927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:40.803003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:40.805913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:40.807893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4a1172f5-ca5a-40c1-9a0a-39f007effb80 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 1.000744 Jun 21 19:03:40.808861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 54/99] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:39 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:40.837596 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:40.838530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:40.850708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:40.851671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:40.853511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:40.854489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:41.198423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:41.206732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf938861-f329-4c0b-a006-e267f2c61c6b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.451460 Jun 21 19:03:41.207349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 46/100] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:40 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:41.224883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:41.233037 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c53c600c-1faa-4152-9063-d80bd0204fb8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.409951 Jun 21 19:03:41.233674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 55/101] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:40 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:41.273310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-1e382b11-0746-4137-824c-16e4294c0c48 req-21caa4d4-4a7b-4249-8a4c-848b1b5c86aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f6d1d-7ba9-4962-855a-d2eea1afe621", "name": "network-vif-plugged", "status": "completed", "tag": "c5bd35da-4108-4e3e-817f-511997259ea0"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:41.282077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-1e382b11-0746-4137-824c-16e4294c0c48 req-21caa4d4-4a7b-4249-8a4c-848b1b5c86aa service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:41.282521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-1e382b11-0746-4137-824c-16e4294c0c48 req-21caa4d4-4a7b-4249-8a4c-848b1b5c86aa service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:41.294993 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-1e382b11-0746-4137-824c-16e4294c0c48 req-21caa4d4-4a7b-4249-8a4c-848b1b5c86aa service nova] Creating event network-vif-plugged:c5bd35da-4108-4e3e-817f-511997259ea0 for instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 on hv-cinder-84630 Jun 21 19:03:41.300375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-1e382b11-0746-4137-824c-16e4294c0c48 req-21caa4d4-4a7b-4249-8a4c-848b1b5c86aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091880 Jun 21 19:03:41.300983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 47/102] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:41.768027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:41.768600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:41.775809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:41.776309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:41.777212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:41.777772 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:41.842249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:41.842973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:41.849679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:41.850129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:41.850939 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:41.851373 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:42.060754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.070697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3776001e-d3fb-40e6-bef6-67d784c8cea9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.305942 Jun 21 19:03:42.071294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 56/103] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:41 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:42.133007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.141744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.143526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.144675 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e2a615f0-c9b6-4e64-84d1-55819b47b16f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.306935 Jun 21 19:03:42.145260 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 48/104] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:41 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:42.224515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:42.225179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:42.231403 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:42.231855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:42.232623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:42.233053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:42.248883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:42.249561 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:42.256891 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:42.257386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:42.258198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:42.258633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:42.433671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.443206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ee9e6ecb-b866-40cf-9e53-d41d02418cab tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.223103 Jun 21 19:03:42.443789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 57/105] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:42 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:42.463175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:42.477068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-29bc0199-4c87-425a-b8d8-7f2a3b581e57 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.231597 Jun 21 19:03:42.478110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 49/106] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:42 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:43.088213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:43.088847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:43.095502 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.095959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.096762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.097242 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.166294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:43.167339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:43.177265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.178302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.180428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.181571 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.306961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.317850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0ea7a354-d6f6-4432-b0f8-a0b0565b0bc3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.233490 Jun 21 19:03:43.318458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 58/107] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:43 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:43.372181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.381217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.382731 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.383905 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-46f21a91-d8fb-43b7-9de8-7991eeababd4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.222020 Jun 21 19:03:43.384470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 50/108] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:43 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:43.459916 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:43.460539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:43.466784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.467231 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.468014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.468440 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.495066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:43.495800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:43.503697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.504152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.504937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:43.505400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:43.688654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.693027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:43.697745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c89a6cb0-cdc4-4257-9ae0-0295bec4589f tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.241698 Jun 21 19:03:43.698418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 59/109] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:43 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:43.703756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-64338373-bffe-4879-912d-87bfd72cd4c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.212620 Jun 21 19:03:43.704791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 51/110] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:43 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:44.338864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:44.339936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:44.348241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.348683 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.349477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.349908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.407470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:44.408646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:44.419910 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.420616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.422050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.422863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.552867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:44.561879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-af9ff7c7-23e3-4a01-b769-fef9fb872342 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.230032 Jun 21 19:03:44.562955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 60/111] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:44 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:44.610592 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:44.619602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:44.621149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:44.622290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e37c6909-f6a4-4ca1-aba3-0e6ccfa87772 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.222421 Jun 21 19:03:44.622871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 52/112] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:44 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:44.715450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:44.716079 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:44.723162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.723448 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:44.723596 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.724053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:44.724369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.724816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.733199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.733886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:44.734868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:44.736171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:45.072693 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.076892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.087305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-83f57c26-1c3a-48bb-b6b2-cfa109d822df tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.374192 Jun 21 19:03:45.088866 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 61/113] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:44 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:45.090517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-829d1e5c-5a19-48ce-90fa-91bd89e29a86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.371917 Jun 21 19:03:45.091381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 53/114] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:44 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:45.584751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:45.585385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:45.591849 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:45.592303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:45.593120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:45.593552 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:45.644407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:45.645896 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:45.659420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:45.660189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:45.661782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:45.662561 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:45.902615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.917527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b3af7dcd-8032-4344-a43e-898ec09af045 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.336149 Jun 21 19:03:45.918708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 62/115] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:45 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:45.968257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.977622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.979113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:45.980249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-142dd70e-e06e-4bea-9e2f-1cdaa6a0edd0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.343244 Jun 21 19:03:45.980903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 54/116] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:45 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:46.107286 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:46.109070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:46.112738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:46.114010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:46.120667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.121451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:46.123001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.123750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:46.125387 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.126721 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:46.128113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.128897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:46.398691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:46.415262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-deed636d-eae3-4cda-a218-46cc413935ea tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.311899 Jun 21 19:03:46.422112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:46.425984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 63/117] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:46 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:46.454053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fb925d82-f299-4f0b-b475-c6baf6b6799d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.349205 Jun 21 19:03:46.456780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 55/118] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:46 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:46.944080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:46.947316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:46.967537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=78 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:46.974637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.977926 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:46.982151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:46.983972 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.009480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:47.010736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:47.035377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.036843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.038503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.039529 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.058224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:47.519646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.538212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.540419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.541284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.544119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:47.544788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-66840bb5-f57a-4b0d-a5db-0412069a85b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.547896 Jun 21 19:03:47.545979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 56/119] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:46 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:47.561551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7f05465a-16e2-4599-9c87-157268a551b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.624431 Jun 21 19:03:47.565336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 64/120] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:46 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:47.573992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-29703333-6b3f-4e85-b3ac-538ed30e14c2 req-e706168b-5356-4e51-aa87-fdafd748c928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "name": "network-vif-plugged", "status": "completed", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:47.577373 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:47.578536 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:47.583803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-29703333-6b3f-4e85-b3ac-538ed30e14c2 req-e706168b-5356-4e51-aa87-fdafd748c928 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.584578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-29703333-6b3f-4e85-b3ac-538ed30e14c2 req-e706168b-5356-4e51-aa87-fdafd748c928 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.592374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.593185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.594561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.595909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.600216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-29703333-6b3f-4e85-b3ac-538ed30e14c2 req-e706168b-5356-4e51-aa87-fdafd748c928 service nova] Creating event network-vif-plugged:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:03:47.608282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-29703333-6b3f-4e85-b3ac-538ed30e14c2 req-e706168b-5356-4e51-aa87-fdafd748c928 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051355 Jun 21 19:03:47.609272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 57/121] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:47.617678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:47.618727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:47.626403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.627235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.628955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:47.629666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:47.922579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.928956 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:47.935551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6aa32014-5382-4bc3-874b-3381cc88bd9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.324690 Jun 21 19:03:47.936527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 58/122] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:47 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:47.941123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cdc8190c-6c15-46d5-95cd-4d2904fbd743 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.373295 Jun 21 19:03:47.941880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 65/123] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:47 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:48.578267 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:48.579925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:48.586209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:48.587470 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:48.590908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.591880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.593436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.594918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.601878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.603065 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.604101 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.604845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.933840 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:48.942575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:48.951290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:48.955531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:48.958312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0f2bd37b-9fc7-49e7-98bf-cf78b51766d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.388765 Jun 21 19:03:48.959421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 59/124] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:48 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:48.966307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f637df01-87ef-4510-8ec3-1cd53d16959c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.389844 Jun 21 19:03:48.967245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 66/125] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:48 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:48.968835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:48.970531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:48.982355 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.983485 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.985038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:48.986606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:48.995786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:48.996854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:49.009279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:49.010023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:49.011556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:49.012317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:49.271714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:49.276662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:49.282763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fb94a796-e990-4063-a33e-56ab5d6844a4 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.320872 Jun 21 19:03:49.283534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 60/126] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:48 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:49.289921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ea54926-8da9-484d-9a91-2bdde731591b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.319231 Jun 21 19:03:49.290798 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 67/127] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:48 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:49.984616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:49.985417 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:49.991965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:49.992541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:49.993428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:49.993938 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:49.999066 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:50.000332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:50.009489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.009928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.011150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.011747 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.293227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.306453 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bc1ba23e-7af7-48f6-98c0-5c987b0184ed tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.325624 Jun 21 19:03:50.307398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 61/128] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:49 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:50.316180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:50.317192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:50.327150 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.327720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.328822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.329873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.350020 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.366337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.369824 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.371876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f00857cf-3c59-4bc0-b8eb-39a586684bb9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.382161 Jun 21 19:03:50.373189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 68/129] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:49 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:50.385530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:50.386901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:50.397458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.398125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.399407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:50.400125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:50.548776 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.559675 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-edff3bb0-e8b7-4195-bbb6-58eeb39512f0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.250905 Jun 21 19:03:50.569319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 62/130] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:50 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:50.602157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:50.612924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-acd95919-d52c-4876-bec2-4431740e3912 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.237772 Jun 21 19:03:50.613746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 69/131] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:50 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:51.333718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:51.334616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:51.341650 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.342091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.343116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.344349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.398480 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:51.399160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:51.405598 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.406435 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.407262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.407890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.588861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:51.600748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-463b6210-86af-4152-a789-7bc5b184b97f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.272717 Jun 21 19:03:51.601402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 63/132] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:51 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:51.607086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:51.613217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:51.632233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.633554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.636250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.637449 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.680587 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:51.719694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:51.726264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:51.734477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-56d7e34a-ead6-4b6e-a8f3-8ef34403e7b3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.341280 Jun 21 19:03:51.736036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 70/133] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:51 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:51.784974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:51.786172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:51.795526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.796444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.798331 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:51.799962 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:51.970625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:51.982941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0c48dfeb-753b-463a-9d4c-c1d46008a608 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.378896 Jun 21 19:03:51.983757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 64/134] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:51 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:52.021809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:52.030179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-694d3cc7-d4ff-402e-b746-c122bb1aeb0e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.265247 Jun 21 19:03:52.035644 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 71/135] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:51 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:52.623244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:52.627671 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:52.645030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:52.645848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:52.647195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:52.647980 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:52.758429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:52.760446 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:52.776969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:52.778260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:52.783917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:52.785013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:53.040912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.055586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5eb7526a-53da-4662-98b4-081b63d97f40 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.440518 Jun 21 19:03:53.057341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 65/136] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:52 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:53.066764 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:53.068554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:53.079883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:53.081149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:53.082907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:53.084098 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:53.099970 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.111935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.113840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.115019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d98c895f-c914-4573-84b2-0d8738dd8c32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.363873 Jun 21 19:03:53.116349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 72/137] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:52 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:53.127288 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:53.128259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:53.136653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:53.137151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:53.138429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:53.139055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:53.438654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.451503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8757a722-ad1b-426d-91a4-e484ada8885e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.333697 Jun 21 19:03:53.452214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 73/138] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:53 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:53.467019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:53.487111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1cd32010-917f-4793-aa61-0addc6b1c16b tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.427633 Jun 21 19:03:53.488576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 66/139] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:53 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:54.093537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:54.095109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:54.104394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.105000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.106036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.106586 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.151809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:54.155416 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:54.163078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=90 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:54.182026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.182984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.184266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.185346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.427320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.442678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fc9ba2d3-e8c6-4e68-b56f-6fc74e408d69 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.354207 Jun 21 19:03:54.444274 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 74/140] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:54 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:54.472481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.485310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:54.488084 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.488319 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:54.492381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.494374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ea61fad5-5406-4d21-b172-63064a5f0a28 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.350215 Jun 21 19:03:54.496397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 67/141] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:54 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:54.507406 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.507955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.508933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.509676 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.519874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:54.521252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:54.532689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.533692 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.535459 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.536582 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.907908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.911090 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:54.916718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-094fb3b7-90eb-4e1f-8a2e-d71db138e171 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.439257 Jun 21 19:03:54.917344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 75/142] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:54 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:54.918848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-933936a9-4fb8-429b-8a42-3256e408b086 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.404118 Jun 21 19:03:54.919539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 68/143] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:54 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:54.923431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-925c51bc-2246-47f8-bee9-7c8eb7a59a83 req-d5ebd167-ab07-4ef7-8bd6-e00d0844b02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b", "name": "network-vif-plugged", "status": "completed", "tag": "c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:54.933033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-925c51bc-2246-47f8-bee9-7c8eb7a59a83 req-d5ebd167-ab07-4ef7-8bd6-e00d0844b02b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:54.933513 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-925c51bc-2246-47f8-bee9-7c8eb7a59a83 req-d5ebd167-ab07-4ef7-8bd6-e00d0844b02b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:54.946533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-925c51bc-2246-47f8-bee9-7c8eb7a59a83 req-d5ebd167-ab07-4ef7-8bd6-e00d0844b02b service nova] Creating event network-vif-plugged:c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7 for instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b on hv-cinder-84630 Jun 21 19:03:54.955753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-925c51bc-2246-47f8-bee9-7c8eb7a59a83 req-d5ebd167-ab07-4ef7-8bd6-e00d0844b02b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Jun 21 19:03:54.956909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 76/144] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:55.471504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:55.472567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:55.482587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.483346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.484625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.485414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.528343 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:55.529530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:55.538426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.539199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.540045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.540634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.782881 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:55.785795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:55.792024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-67bd458e-7952-4f37-bcad-380c6bf954c6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.327768 Jun 21 19:03:55.793010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 69/145] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:55 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:55.794874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:55.796465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:55.797845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-beee11ad-87a5-4eaf-806a-845b64235c8d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.286351 Jun 21 19:03:55.798507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 77/146] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:55 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:55.936482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:55.937398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:55.945413 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:55.945843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.946499 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.947064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:55.947686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.948310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.964515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.965424 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:55.968397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:55.969149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:56.469354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:56.477317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:56.485302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c19f7fb0-e4ff-49ac-83ac-b0d48fc77add tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.553273 Jun 21 19:03:56.486609 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 70/147] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:55 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:56.502018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-79379b20-b60f-4008-abe9-464cfb71ff74 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.561412 Jun 21 19:03:56.502635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 78/148] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:55 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:56.814246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:56.815236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:56.817922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:56.818908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:56.825130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:56.826126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:56.827314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:56.828303 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:56.830984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:56.831598 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:56.833129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:56.833473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:57.064995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.077312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ffe889f9-06b3-4804-a2f5-77a307be05ee tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.268487 Jun 21 19:03:57.083278 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.091889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 71/149] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:56 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:57.095247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.096300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.097518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f4dc3be3-b1f4-4db3-bbf8-9351bff8d916 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.285442 Jun 21 19:03:57.098225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 79/150] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:56 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:57.505683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:57.506434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:57.513074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:57.513554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:57.514339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:57.516397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:57.526903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:57.528320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:57.539875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:57.540339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:57.541205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:57.541630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:57.755971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.756137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:57.764119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-67e13928-6884-4660-972b-1e0499da9e7d tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.246319 Jun 21 19:03:57.774814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 80/151] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:57 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:03:57.807378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-56fce060-1cca-4d36-8e01-40509bf604ff tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.305141 Jun 21 19:03:57.808835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 72/152] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:57 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:58.107897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:58.110606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:58.125073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:58.128089 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.129325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.129584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:58.131176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.132976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.163926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.164832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.175055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.182691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.244187 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:58.441895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:58.454819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:58.475098 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:58.477062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:58.478397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-deaff20e-3abb-4dd8-93b8-1651907038ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.362075 Jun 21 19:03:58.478829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-25d665b1-11ff-4103-8bae-317533926e39 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.381380 Jun 21 19:03:58.479282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 73/153] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:58 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:03:58.492848 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 81/154] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:58 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:58.782209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:58.782922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:58.789520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.789967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.790770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.791202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.825827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:58.826598 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:58.834612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.835060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.835868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:58.836306 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:58.841208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:03:59.015258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.028227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d4d10778-45dd-4e03-8af3-3c919ee55643 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.249558 Jun 21 19:03:59.030187 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 74/155] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:58 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:59.057972 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.068370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fde4a8d7-c3af-4cb9-967e-f390622c49e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.247009 Jun 21 19:03:59.069228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 82/156] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:58 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:03:59.425590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-a2c33e97-5a5f-402c-af95-c172ab8688ea req-dd4088a3-df7a-4328-822d-6171a5af5e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c71b4bb-1be3-4662-aa0b-78d6acfa27ff", "name": "network-vif-plugged", "status": "completed", "tag": "ec0ef0ca-8788-4f95-bf71-f3ce17595dce"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:03:59.441226 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a2c33e97-5a5f-402c-af95-c172ab8688ea req-dd4088a3-df7a-4328-822d-6171a5af5e8f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:59.441966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a2c33e97-5a5f-402c-af95-c172ab8688ea req-dd4088a3-df7a-4328-822d-6171a5af5e8f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:59.459828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-a2c33e97-5a5f-402c-af95-c172ab8688ea req-dd4088a3-df7a-4328-822d-6171a5af5e8f service nova] Creating event network-vif-plugged:ec0ef0ca-8788-4f95-bf71-f3ce17595dce for instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff on hv-cinder-84630 Jun 21 19:03:59.467255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-a2c33e97-5a5f-402c-af95-c172ab8688ea req-dd4088a3-df7a-4328-822d-6171a5af5e8f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048562 Jun 21 19:03:59.468136 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 75/157] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:03:59.499813 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:59.501639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:59.512121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:59.513003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:59.525824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:03:59.526806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:59.528252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:03:59.529442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:59.550976 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:59.551758 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:59.553147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:03:59.553956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:03:59.902712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.913505 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.915687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.917064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1b6623ef-62cd-47f9-9486-55a3b2e52a14 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.422801 Jun 21 19:03:59.917652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 83/158] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:03:59 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:03:59.919178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:03:59.939905 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d2dff972-152c-49ce-8284-5152a96673a6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.421892 Jun 21 19:03:59.942182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 76/159] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:03:59 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:00.049422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:00.050315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:00.063787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.065047 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.067195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.068399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.106579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:00.106963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:00.118948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.119663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.120895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.121578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.492151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:00.502566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:00.513574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c26848a1-c119-4e65-8bb0-0745ae29401a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.470271 Jun 21 19:04:00.517444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 84/160] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:00 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:00.527555 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-748a7543-4854-4909-9fb5-bd24d96440b3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.436554 Jun 21 19:04:00.530313 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 77/161] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:00 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:00.939823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:00.941370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:00.962615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.962615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.962615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:00.962615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:00.971780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:00.975245 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:00.999430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:01.000390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:01.002242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:01.007471 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:01.908592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:01.943453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:01.946844 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:01.948663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f6ac360a-c756-4cc8-ae8b-365e6ba42df2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 1.015845 Jun 21 19:04:01.949639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 85/162] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:00 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:04:01.990171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:01.991995 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:02.004414 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:02.005691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:02.007332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:02.008330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:02.453706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:02.465551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-339d5e4b-32c8-4eb4-b239-0bf66bca9c72 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 1.501159 Jun 21 19:04:02.481339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 78/163] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:00 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:02.497578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:02.498663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:02.510864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:02.511978 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:02.513342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:02.514316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:02.712238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:02.739344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2416aadb-eda6-45c9-93c6-c0dd9f27cfe1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.771717 Jun 21 19:04:02.743317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 86/164] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:01 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:02.971099 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:02.979484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-96ed0a25-cf51-4458-9330-8683b23b85bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.496485 Jun 21 19:04:02.980077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 79/165] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:02 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:02.989006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:02.989871 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:02.996684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.005123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.006332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.006935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.408535 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:03.428370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:03.432848 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:03.435166 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-baccc9be-b49a-4a88-8f5c-14b5c17d0d7a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.450376 Jun 21 19:04:03.437148 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 87/166] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:02 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:04:03.499812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:03.500874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:03.507302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.507883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.508931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.509638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.703412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:03.714476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-25e0f53b-f155-4825-b3fc-da72790419f8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.219770 Jun 21 19:04:03.715205 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 80/167] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:03 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:03.772668 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:03.774959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:03.781729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.782775 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.783736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:03.784178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:03.957173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:03.964743 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0783816f-4dfb-4359-9625-a28562c81778 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.196453 Jun 21 19:04:03.965714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 88/168] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:03 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:04.009026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:04.009693 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:04.017914 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.018366 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.019201 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.019632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.186560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:04.200257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-07e00774-f34d-40d5-a8e5-3ca92acdac47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.194818 Jun 21 19:04:04.201299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 81/169] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:04 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:04.454784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:04.455575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:04.465679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.466582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.468064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.468923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.678576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:04.687941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:04.690051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:04.691512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df2da8d0-7efe-4429-8029-5a4a81e454f1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.241150 Jun 21 19:04:04.692087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 89/170] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:04 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:04:04.735603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:04.736329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:04.743187 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.743714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.744567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.745082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.921925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:04.930182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d700c115-7d8f-4b99-bf2e-d71f50d06ab8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.199377 Jun 21 19:04:04.930809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 82/171] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:04 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:04.982646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:04.983264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:04.990127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.990489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:04.991251 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:04.991682 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.168716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:05.185864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2bb0c8de-b4f5-4bae-a3d9-bd5a9c157aa0 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.206561 Jun 21 19:04:05.186909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 90/172] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:04 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:05.230601 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:05.231550 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:05.239682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.240188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.240902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.241366 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.407589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:05.420391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e3932476-768d-4f04-99c8-dbaa5fb8dfb7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.197906 Jun 21 19:04:05.421491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 83/173] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:05 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:05.709358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:05.710142 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:05.716855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.717327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.718105 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.718909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.870762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:05.885010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:05.887943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:05.889936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bd37b1b1-bf9e-4f26-9a2c-ccf13e7c6cf6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.184377 Jun 21 19:04:05.891402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 91/174] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:05 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:04:05.948749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:05.949488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:05.957505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.958006 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:05.958963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:05.959501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.108659 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:06.121137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-877d41b0-821f-4d43-849c-77aada37357d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.176401 Jun 21 19:04:06.122129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 84/175] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:05 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:06.208560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:06.209430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:06.219787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.220384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.221773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.222537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.383400 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:06.391923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eede6e63-5002-4d72-9771-f6e3f60173ae tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.187805 Jun 21 19:04:06.392498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 92/176] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:06 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:06.445669 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:06.446282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:06.452590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.453037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.454444 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.454881 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.598770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:06.606882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a4a4cdb3-0d7e-42fd-b631-893f129c3038 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.165084 Jun 21 19:04:06.607466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 85/177] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:06 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:06.918867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:06.919622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:06.926789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.927245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:06.928042 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:06.928588 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.083036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.091646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.093129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.094861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e3e8037a-b562-424c-9f53-e3799b53a8fd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.179486 Jun 21 19:04:07.095494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 93/178] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:06 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:04:07.139402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:07.140444 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:07.148431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.148887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.149713 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.150149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.356538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.367290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c695e73e-8285-4a9a-96fd-58364e398603 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.232688 Jun 21 19:04:07.368003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 86/179] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:07 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:07.413384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:07.414411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:07.422782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.423405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.424266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.424751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.633232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:07.635318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:07.644442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.650369 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.651558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.653219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:07.655012 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:07.655383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b0f763fb-0283-4b8d-8668-fdb5a8a48811 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.248902 Jun 21 19:04:07.657459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 94/180] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:07 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:07.893436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:07.905625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-04025de2-b1e0-4805-b9d4-478c3a6a4522 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1322 microversion: 2.1 time: 0.282861 Jun 21 19:04:07.906380 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 87/181] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:07 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:08.119809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:08.120949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:08.150964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.151761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.153145 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.160510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.399310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:08.401035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:08.415404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.417041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.419337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.421836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.474212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:08.483193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:08.486139 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:08.487305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-27785674-1c50-44ed-a69a-30428237f740 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.374355 Jun 21 19:04:08.488205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 95/182] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:08 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:04:08.647614 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:08.661725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a74d23f8-8edd-4a15-9e29-507103059e50 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.272311 Jun 21 19:04:08.662912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 88/183] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:08 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:08.686476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:08.687095 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:08.694455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.695559 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.696356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.696800 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.872425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:08.885746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9236f2e3-7558-4297-a3e8-dc18348565b8 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1315 microversion: 2.1 time: 0.202834 Jun 21 19:04:08.886600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 96/184] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:08 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:08.930306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:08.931161 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:08.938403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.939076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:08.939885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:08.940320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.114112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:09.126457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e903cf69-0ac2-4eeb-83af-25b21d041556 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1515 microversion: 2.1 time: 0.200066 Jun 21 19:04:09.127688 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 89/185] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:08 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:09.146015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:09.147032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:09.154043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.154627 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.155352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.155989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.266728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'flavor' on Instance uuid da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:04:09.436320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:09.519027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:09.519847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:09.527998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.530070 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.531059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.531714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.559844 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-68b30b61-903f-47b1-99e0-7785d5d19e96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b/action" status: 200 len: 32 microversion: 2.1 time: 0.417850 Jun 21 19:04:09.567896 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 97/186] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:04:09 2022] POST /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:04:09.578863 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:09.580305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:09.592374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.593392 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:09.594951 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:09.596089 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.183168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.195092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f802aaf7-c978-48f4-90ef-f66e84744ed9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.624552 Jun 21 19:04:10.196037 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 98/187] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:09 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:10.196551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.200265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:10.204367 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-92951a68-6a82-4512-9a13-08c6940e8c3d req-d52d86f3-d792-40b6-b964-47c13aec2369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a342ffaa-5a3b-44f2-8bd6-309d7768b588", "name": "network-vif-plugged", "status": "completed", "tag": "dec56129-7c7f-479b-a8a4-27f8c5ef76c0"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:10.216878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.220364 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-92951a68-6a82-4512-9a13-08c6940e8c3d req-d52d86f3-d792-40b6-b964-47c13aec2369 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:10.221142 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-92951a68-6a82-4512-9a13-08c6940e8c3d req-d52d86f3-d792-40b6-b964-47c13aec2369 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.221325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.227167 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-42718e82-7e96-4826-99b6-1a9f44fbb68e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1405 microversion: 2.20 time: 0.709511 Jun 21 19:04:10.241122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 90/188] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:09 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1405 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:04:10.241122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:10.241122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:10.252002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:10.252730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.254068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:10.254805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.263512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-92951a68-6a82-4512-9a13-08c6940e8c3d req-d52d86f3-d792-40b6-b964-47c13aec2369 service nova] Creating event network-vif-plugged:dec56129-7c7f-479b-a8a4-27f8c5ef76c0 for instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 on hv-cinder-84630 Jun 21 19:04:10.276415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-92951a68-6a82-4512-9a13-08c6940e8c3d req-d52d86f3-d792-40b6-b964-47c13aec2369 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077451 Jun 21 19:04:10.277973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 99/189] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:10.290979 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:10.292641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:10.305221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:10.306420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.308123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:10.308847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:10.780753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.793492 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c10340e3-95f8-4326-a65c-ff22b2b09dce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1361 microversion: 2.1 time: 0.562718 Jun 21 19:04:10.794569 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 91/190] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:10 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1361 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:10.830653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:10.843949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-784d0200-7b5a-4c5e-aed6-dae8af8fe164 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1503 microversion: 2.1 time: 0.562307 Jun 21 19:04:10.844944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 100/191] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:10 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1503 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:11.214530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:11.215473 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:11.237605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.239827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.251608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.254032 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.263092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:11.264463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:11.278501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.279614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.282638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.283367 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.853571 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:11.874592 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9593493d-bc8f-4392-a611-2fbe199477b4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.664742 Jun 21 19:04:11.874777 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:11.876212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 92/192] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:11 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:11.885412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:11.887197 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:11.890176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:11.893814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:11.895849 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5719ac17-192f-4015-b972-c158fcceb3e6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1596 microversion: 2.20 time: 0.639238 Jun 21 19:04:11.897021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 101/193] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:04:11 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1596 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:04:11.898289 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.898882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.899817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.900493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.919561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:11.920897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:11.933983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.935014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:11.936618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:11.937641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:12.257081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0dc2a881-3e1b-4b14-8da7-fcae3dd99bff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.345576 Jun 21 19:04:12.257939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 102/194] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jun 21 19:04:11 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-interface => generated 284 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:04:12.836686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:12.839652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9366eaf-f95c-4b21-850d-32ee13eb0ba4"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:12.853812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:12.876253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-023dc1de-a03e-47d5-b71d-f3f3ed00bbc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1548 microversion: 2.1 time: 0.993118 Jun 21 19:04:12.878180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 93/195] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:11 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1548 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:12.885606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:12.895186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:12.896903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:12.897984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:12.902461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:12.904836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:12.927031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:12.938628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:12.942965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:12.950325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:13.851988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:13.861679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0d315662-f43e-410d-8753-ec5940a6f7e6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.971099 Jun 21 19:04:13.873871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 94/196] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:12 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:13.879158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:13.879785 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:13.894231 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:13.894871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:13.895851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:13.896448 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:13.958532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c409469a-edf0-4076-b9c3-f43a27861133 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "POST /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125269 Jun 21 19:04:13.960534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 103/197] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:04:12 2022] POST /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621/os-volume_attachments => generated 194 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:14.366643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c285dd18-6c30-40b5-a5d0-4bb4b601d9b8 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.489856 Jun 21 19:04:14.376904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 95/198] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:04:13 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-interface => generated 285 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:14.894391 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:14.895468 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:14.903165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:14.904035 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:14.905196 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:14.905867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:15.730846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:15.744554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-db1f6031-a78d-4106-9b84-ba04ba655093 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.857047 Jun 21 19:04:15.749168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 104/199] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:14 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:16.131717 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-86fae4ab-3ab7-430f-84c4-a480bb82e77d req-66dc9621-a5b0-4615-802b-3aab79541daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:16.161912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-86fae4ab-3ab7-430f-84c4-a480bb82e77d req-66dc9621-a5b0-4615-802b-3aab79541daf service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:16.163106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-86fae4ab-3ab7-430f-84c4-a480bb82e77d req-66dc9621-a5b0-4615-802b-3aab79541daf service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:16.205397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-86fae4ab-3ab7-430f-84c4-a480bb82e77d req-66dc9621-a5b0-4615-802b-3aab79541daf service nova] Creating event network-changed:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:04:16.226611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-86fae4ab-3ab7-430f-84c4-a480bb82e77d req-66dc9621-a5b0-4615-802b-3aab79541daf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106601 Jun 21 19:04:16.227239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 96/200] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:16.777779 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:16.779013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:16.817022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:16.818253 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:16.819643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:16.834329 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:17.108801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-bee7fa07-2b61-4247-83c8-966a2dfa68ca req-bb1df2de-df88-4a2f-a3a9-e85842a335d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c71b4bb-1be3-4662-aa0b-78d6acfa27ff", "tag": "ec0ef0ca-8788-4f95-bf71-f3ce17595dce"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:17.153465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bee7fa07-2b61-4247-83c8-966a2dfa68ca req-bb1df2de-df88-4a2f-a3a9-e85842a335d0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:17.154104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-bee7fa07-2b61-4247-83c8-966a2dfa68ca req-bb1df2de-df88-4a2f-a3a9-e85842a335d0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:17.180442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-bee7fa07-2b61-4247-83c8-966a2dfa68ca req-bb1df2de-df88-4a2f-a3a9-e85842a335d0 service nova] Creating event network-changed:ec0ef0ca-8788-4f95-bf71-f3ce17595dce for instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff on hv-cinder-84630 Jun 21 19:04:17.199076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-bee7fa07-2b61-4247-83c8-966a2dfa68ca req-bb1df2de-df88-4a2f-a3a9-e85842a335d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099097 Jun 21 19:04:17.199823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 97/201] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:17.408862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:17.433281 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4ffd6a2f-d0e7-4553-9c25-5053c6afdee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.662009 Jun 21 19:04:17.450814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 105/202] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:16 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:18.465172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:18.465902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:18.473805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:18.474039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:18.475008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:18.475665 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:18.965762 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:18.990678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a4fb239b-f310-4ac0-9909-07bec033ec6b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.522122 Jun 21 19:04:18.990678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 98/203] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:18 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:20.004928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:20.005803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:20.008344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=84 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:20.014373 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:20.014827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:20.016279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:20.016714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:20.289792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:20.299048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-322572d5-df47-4630-958c-d8f892c4f201 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.297764 Jun 21 19:04:20.299677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 106/204] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:19 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:21.317687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:21.318297 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:21.325240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:21.326613 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:21.326802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:21.327400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:21.487616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:21.502308 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8f09a812-88d1-4ceb-8271-a770f88fe117 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.189720 Jun 21 19:04:21.503325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 99/205] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:21 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:22.520729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:22.521279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:22.528093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:22.528530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:22.529331 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:22.529758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:22.667439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:22.675156 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6b2395ed-16d9-4080-a11b-a0e8ba7fee16 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.158530 Jun 21 19:04:22.675730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 107/206] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:22 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:23.692743 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:23.693399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:23.700864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:23.701362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:23.702429 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:23.703464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:24.063669 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:24.071581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2b0b9c4d-ded1-405b-be77-4d2ae160869c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.382924 Jun 21 19:04:24.072175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 100/207] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:23 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:25.088237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:25.089059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:25.096221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:25.096679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:25.097931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:25.097931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:25.242551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:25.252983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0b2c52e1-c3a3-469a-92e3-d33995107a49 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.168644 Jun 21 19:04:25.253619 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 108/208] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:25 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:26.273484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:26.274200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:26.276520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=68 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:26.282377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:26.282886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:26.283663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:26.284158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:26.439466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:26.453596 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-618acc6d-593c-47f4-9883-34c4561f41a6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.186563 Jun 21 19:04:26.454671 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 101/209] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:26 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:27.397681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:27.398278 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:27.407305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.407746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.408760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.409497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.450347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:04:27.480807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:27.481305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:27.489655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.490174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.491176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.491907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.610887 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a408d147-d8fc-485a-87f9-26b863d5bbe9 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 204 len: 0 microversion: 2.1 time: 0.225141 Jun 21 19:04:27.613950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 109/210] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:04:27 2022] DELETE /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:04:27.628118 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:27.632815 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:27.656151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.656649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.657538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:27.658163 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:27.758838 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:27.783049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f7476b11-3121-496c-b8c0-751f6c97930c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.307530 Jun 21 19:04:27.786660 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 102/211] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:27 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:27.881171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:27.890589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7e24ac9d-e9e6-4ebe-891d-65f7df589539 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1555 microversion: 2.1 time: 0.271012 Jun 21 19:04:27.891726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 110/212] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:27 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:28.806904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:28.806904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:28.815475 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:28.816323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:28.817624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:28.818374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:28.918206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:28.919048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:28.928262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:28.928729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:28.929601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:28.930576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:28.967623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:29.041432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:29.056194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9ce06c07-d92c-447c-938b-b6fd7887c2f6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.257047 Jun 21 19:04:29.056780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 103/213] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:28 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:29.136566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:29.153386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c79550c2-42e5-42c1-9dfa-13b1e4338a77 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1555 microversion: 2.1 time: 0.239826 Jun 21 19:04:29.155269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 111/214] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:28 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:30.084791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:30.086746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:30.101368 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:30.116319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:30.122621 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:30.123925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:30.176148 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:30.176942 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:30.198773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:30.199345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:30.201426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:30.204427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:30.734000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:30.747739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a31569ed-5637-43eb-9d2c-6a42ad1d721e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.670542 Jun 21 19:04:30.758524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 104/215] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:30 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:30.864510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:30.879269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6b087541-589e-4a32-a52f-06f195850301 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1555 microversion: 2.1 time: 0.708829 Jun 21 19:04:30.880307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 112/216] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:30 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1555 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:31.733837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e6a2fd20-8886-41c8-902f-6212ab29d9d0 req-48feb54b-7e7c-42b0-99eb-f20b24c01f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7f6d1d-7ba9-4962-855a-d2eea1afe621", "name": "network-vif-deleted", "tag": "c5bd35da-4108-4e3e-817f-511997259ea0"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:31.788038 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:31.792552 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:31.797756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e6a2fd20-8886-41c8-902f-6212ab29d9d0 req-48feb54b-7e7c-42b0-99eb-f20b24c01f60 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:31.801290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e6a2fd20-8886-41c8-902f-6212ab29d9d0 req-48feb54b-7e7c-42b0-99eb-f20b24c01f60 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:31.818879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:31.819292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:31.820083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:31.820520 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:31.829390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e6a2fd20-8886-41c8-902f-6212ab29d9d0 req-48feb54b-7e7c-42b0-99eb-f20b24c01f60 service nova] Creating event network-vif-deleted:c5bd35da-4108-4e3e-817f-511997259ea0 for instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 on hv-cinder-84630 Jun 21 19:04:31.837702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e6a2fd20-8886-41c8-902f-6212ab29d9d0 req-48feb54b-7e7c-42b0-99eb-f20b24c01f60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107896 Jun 21 19:04:31.838334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 105/217] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:04:31.899928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:31.900795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:31.911071 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:31.912150 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:31.913292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:31.913980 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:32.291362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ee05285e124183a43f5757fd94ec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22f07bc3f5641d19b56a56257d0c951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:32.307487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-522e9f9a-6335-4019-98ff-265892c74dd5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 200 len: 1346 microversion: 2.1 time: 0.413139 Jun 21 19:04:32.309699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 106/218] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:31 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 1346 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:32.509285 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:32.525914 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ddb975d2-61fb-4415-8fb8-b40726948b1a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.750729 Jun 21 19:04:32.527935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 113/219] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:31 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:33.328681 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:33.344515 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:33.347661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.348121 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.348892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.349354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.364705 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] HTTP exception thrown: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Request method failure captured: Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 HTTP/1.1 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXgqr9NF8WaD5v8QhZV3bu9hS8870C7V10KCePNqM1KW1aVDmE3qQ_I5y3_VxeDqls_TxtX-eCeJmhpITjuWBnqzez-qREJtg97KHrX7eC31yVyaNnTWkzUbg6tYZUqwPmswWWNLw0CnuIj0EfhJrFqroNwc6BevReGAnysb64PNNE Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:04:33.375791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}] Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: a7ee05285e124183a43f5757fd94ec40 Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.377631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '7d7f6d1d-7ba9-4962-855a-d2eea1afe621'} Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:04:33.378405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.379612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.382498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Returning 404 to user: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:04:33.382498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-954ba820-f86e-48db-afcf-80ae1bd1dd0a tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 404 len: 111 microversion: 2.1 time: 0.054471 Jun 21 19:04:33.382498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 107/220] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:33 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:04:33.503885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:33.504766 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:33.512864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.513885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.515146 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.515675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.530057 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] HTTP exception thrown: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Request method failure captured: Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621/os-volume_attachments HTTP/1.1 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXgqr9NF8WaD5v8QhZV3bu9hS8870C7V10KCePNqM1KW1aVDmE3qQ_I5y3_VxeDqls_TxtX-eCeJmhpITjuWBnqzez-qREJtg97KHrX7eC31yVyaNnTWkzUbg6tYZUqwPmswWWNLw0CnuIj0EfhJrFqroNwc6BevReGAnysb64PNNE Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:04:33.539085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}] Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: a7ee05285e124183a43f5757fd94ec40 Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.540610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'server_id': '7d7f6d1d-7ba9-4962-855a-d2eea1afe621'} Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:04:33.541494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:33.542971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:33.547085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Returning 404 to user: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:04:33.548241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6f965e8f-0e59-4e55-9295-ebccb959ddf5 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048570 Jun 21 19:04:33.552182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:33.552182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:33.552898 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 114/221] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:04:33 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:04:33.561746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.562199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.563717 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:33.564580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:33.767891 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:33.778042 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5221d1e9-cd9b-4fce-9974-6cf97132d49c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.234081 Jun 21 19:04:33.779550 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 108/222] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:33 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:34.804776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:34.815163 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:34.839753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:34.841412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:34.841784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.842263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.843085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.843524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.856435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.857294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.857704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.862495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.888067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] HTTP exception thrown: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Request method failure captured: Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 HTTP/1.1 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXgqr9NF8WaD5v8QhZV3bu9hS8870C7V10KCePNqM1KW1aVDmE3qQ_I5y3_VxeDqls_TxtX-eCeJmhpITjuWBnqzez-qREJtg97KHrX7eC31yVyaNnTWkzUbg6tYZUqwPmswWWNLw0CnuIj0EfhJrFqroNwc6BevReGAnysb64PNNE Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:04:34.889855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}] Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: a7ee05285e124183a43f5757fd94ec40 Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.891735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '7d7f6d1d-7ba9-4962-855a-d2eea1afe621'} Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:04:34.892892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.894979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.896931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Returning 404 to user: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:04:34.896931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b35773f1-efd1-4761-aa5b-ad92f5e87d00 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 404 len: 111 microversion: 2.1 time: 0.060503 Jun 21 19:04:34.896931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 109/223] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:04:34 2022] DELETE /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:04:34.901734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:34.902476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] [instance: 7d7f6d1d-7ba9-4962-855a-d2eea1afe621] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:34.910525 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.911702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.912627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:34.913329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:34.941800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] HTTP exception thrown: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Request method failure captured: Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 HTTP/1.1 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXgqr9NF8WaD5v8QhZV3bu9hS8870C7V10KCePNqM1KW1aVDmE3qQ_I5y3_VxeDqls_TxtX-eCeJmhpITjuWBnqzez-qREJtg97KHrX7eC31yVyaNnTWkzUbg6tYZUqwPmswWWNLw0CnuIj0EfhJrFqroNwc6BevReGAnysb64PNNE Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:04:34.944884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d22f07bc3f5641d19b56a56257d0c951"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d22f07bc3f5641d19b56a56257d0c951"}]}] Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d22f07bc3f5641d19b56a56257d0c951 Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-DeleteServersTestJSON-1583461853 Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: a7ee05285e124183a43f5757fd94ec40 Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-DeleteServersTestJSON-1583461853-project Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.946132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '7d7f6d1d-7ba9-4962-855a-d2eea1afe621'} Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:04:34.946800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. Jun 21 19:04:34.947853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:04:34.950759 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] Returning 404 to user: Instance 7d7f6d1d-7ba9-4962-855a-d2eea1afe621 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:04:34.952103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-faf75f91-31fd-4ffe-b02a-e0ba1be8bef1 tempest-DeleteServersTestJSON-1583461853 tempest-DeleteServersTestJSON-1583461853-project] 10.222.0.70 "GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621" status: 404 len: 111 microversion: 2.1 time: 0.054338 Jun 21 19:04:34.953732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 110/224] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:34 2022] GET /compute/v2.1/servers/7d7f6d1d-7ba9-4962-855a-d2eea1afe621 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:04:35.274918 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:35.288828 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bcae1cf0-7076-4ace-907c-4ce35d288281 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.495953 Jun 21 19:04:35.290047 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 115/225] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:34 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:36.306718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:36.307346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:36.313970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:36.314404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:36.315484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:36.316193 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:36.858621 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:36.864800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:36.893776 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a2b84be7-9762-4c37-a780-6a0fe4a1487d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.582582 Jun 21 19:04:36.901597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 111/226] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:36 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:37.920352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:37.921579 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:37.937604 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:37.939755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:37.944833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:37.945628 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:38.211718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:38.221622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2db1b997-84fb-4bcb-ad75-b8cdef200807 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.305577 Jun 21 19:04:38.222215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 116/227] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:37 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:39.239475 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:39.240260 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:39.255922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:39.256995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:39.258218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:39.258889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:39.560898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:39.584469 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-87a8fe0b-3d3c-4832-8e4d-fcbd5602341c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.347892 Jun 21 19:04:39.590351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 112/228] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:39 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:40.609518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:40.610240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:40.619741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:40.625543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:40.628894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:40.631512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:41.104090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:41.126700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef5461af-238a-44c2-90ee-5a24e2ea7937 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.522377 Jun 21 19:04:41.130687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 117/229] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:40 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:42.145318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:42.145938 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:42.157981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:42.158434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:42.159221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:42.159652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:42.424086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:42.435747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e662fb26-cd5a-400b-a4b3-d96b0c4a851e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.293239 Jun 21 19:04:42.439888 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 113/230] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:42 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:43.277397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bc3a2388-5777-4acc-b11a-bca24f57345e tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Action: 'create', calling method: .version_select at 0x7f3595d2ee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1969369776", "metadata": {"Type": "work"}}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:43.456215 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:43.456960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:43.464450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:43.465331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:43.468075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:43.469285 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:43.623331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:43.632676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8f0b8006-b196-4657-9456-996b4d3974db tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.180325 Jun 21 19:04:43.643041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 114/231] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:43 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:43.699837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bc3a2388-5777-4acc-b11a-bca24f57345e tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.565125 Jun 21 19:04:43.700448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 118/232] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 19:04:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 566 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 19:04:43.711833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d57cc103-ae28-4666-a755-bfe38fad6da4 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f35959cca60>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:43.776945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d57cc103-ae28-4666-a755-bfe38fad6da4 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 200 len: 353 microversion: 2.1 time: 0.068917 Jun 21 19:04:43.777562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 119/233] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:43 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:04:43.834242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3a770f89-2951-4d09-8094-86363b725e86 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Action: 'create', calling method: .version_select at 0x7f3595a9ad30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2006781389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLeJQPNisvGRhfxf7Ed515uQBOfanQ9KM9pE9eX1G0GNLFFzvlaneMxzM4beqL1CtSGQuxHdfZb7iHLOwKyWcn8V/meIWWENyJZUA1V/jK0xD3GqFmlqOP0x57Vo+fTTA=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:04:43.848982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-3a770f89-2951-4d09-8094-86363b725e86 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:04:43.853224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-3a770f89-2951-4d09-8094-86363b725e86 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for user 569256e6d1d1418eafb5ff2ed8909926 and project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:04:43.876254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3a770f89-2951-4d09-8094-86363b725e86 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.232104 Jun 21 19:04:43.876844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 115/234] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:04:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:44.650796 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:44.651929 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:44.658504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:44.658959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:44.659746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:44.660212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:44.792811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8ec41d96-44ac-4fa8-aec0-9e19da58e8c8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595a90940>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:44.852143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:44.862861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cc64bd0a-1bdb-4e79-90a8-272b05558a99 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.215966 Jun 21 19:04:44.866510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 120/235] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:44 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:44.882121 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8ec41d96-44ac-4fa8-aec0-9e19da58e8c8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 200 len: 353 microversion: 2.1 time: 0.093271 Jun 21 19:04:44.883683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 116/236] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:44 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:45.882570 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:45.883175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:45.891253 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:45.891846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:45.892717 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:45.893257 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:45.895822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7253e684-cdb9-47fc-87e4-c9c6bde9bdf7 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595a90160>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:45.949213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7253e684-cdb9-47fc-87e4-c9c6bde9bdf7 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 200 len: 354 microversion: 2.1 time: 0.057143 Jun 21 19:04:45.949977 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 117/237] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:45 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:45.962002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d92a4e9-02d0-46cb-9a53-82d237b63054 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595a87310>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:46.013043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5d92a4e9-02d0-46cb-9a53-82d237b63054 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 200 len: 354 microversion: 2.1 time: 0.054791 Jun 21 19:04:46.014091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 118/238] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:45 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:46.031171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-91ce6c08-44f1-465b-89dd-94ad09539cd8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595a87280>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:46.051593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:46.059090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3266878f-885d-4bf6-8db1-1a1a540565c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.180545 Jun 21 19:04:46.059755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 121/239] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:45 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:46.096420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-91ce6c08-44f1-465b-89dd-94ad09539cd8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 202 len: 0 microversion: 2.1 time: 0.069435 Jun 21 19:04:46.096994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 119/240] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:04:46 2022] DELETE /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:04:46.105296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-520f20e8-2e2c-4054-9250-a178678cdaa8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595b27430>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:46.155653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-520f20e8-2e2c-4054-9250-a178678cdaa8 tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 200 len: 353 microversion: 2.1 time: 0.054283 Jun 21 19:04:46.156232 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 122/241] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:46 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:04:47.078619 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:47.079880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:47.088963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:47.089465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:47.090234 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:47.090704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:47.168316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8e7c4155-1c10-4336-8938-f950fdae7d5a tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Calling method '.version_select at 0x7f3595d2ee50>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:47.213895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-8e7c4155-1c10-4336-8938-f950fdae7d5a tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] HTTP exception thrown: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8e7c4155-1c10-4336-8938-f950fdae7d5a tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Request method failure captured: Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b HTTP/1.1 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishZL1pYQ8KrsQx5Vlhshimhu8mT8S2PTpTWM9taDR105bGp88qZvFmCvVpYwRDtm6Kv5EFZ4f0leDOQF4tgiMTt9K38KBQcKw21jXkB36QrFzTGa25aIC4J_teekbUVQUiiIIu6RcLYxgQjk4g6lmNNhnapfeC6187j8st-1mLXKfNM Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 9f2acd203aab474083cd9ac3271a24c0 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesGetTestJSON-608197484 Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:04:47.217252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9f2acd203aab474083cd9ac3271a24c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9f2acd203aab474083cd9ac3271a24c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9f2acd203aab474083cd9ac3271a24c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9f2acd203aab474083cd9ac3271a24c0"}]}] Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesGetTestJSON-608197484 Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 9f2acd203aab474083cd9ac3271a24c0 Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesGetTestJSON-608197484 Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesGetTestJSON-608197484-project Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 5c0b35e6bb954d7b849e1251a4a130e0 Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesGetTestJSON-608197484-project Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'dae29c3d-ef95-411e-959e-3e2b05d3c23b'} Jun 21 19:04:47.218748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. (HTTP 404) (Request-ID: req-629ac059-b141-44e9-a6fa-ca4bc932ed66) Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:47.219954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:04:47.222224 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 19:04:47.224595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. Jun 21 19:04:47.227070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:04:47.233784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8e7c4155-1c10-4336-8938-f950fdae7d5a tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] Returning 404 to user: Volume dae29c3d-ef95-411e-959e-3e2b05d3c23b could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:04:47.233784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8e7c4155-1c10-4336-8938-f950fdae7d5a tempest-VolumesGetTestJSON-608197484 tempest-VolumesGetTestJSON-608197484-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b" status: 404 len: 109 microversion: 2.1 time: 0.065057 Jun 21 19:04:47.233784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 123/242] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:04:47 2022] GET /compute/v2.1/os-volumes/dae29c3d-ef95-411e-959e-3e2b05d3c23b => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 19:04:47.337996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:47.360818 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3726a885-50a7-46a0-b82e-22dc6fe47900 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.287423 Jun 21 19:04:47.364303 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 120/243] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:47 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:48.384859 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:48.385687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:48.395354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:48.396120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:48.397240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:48.399097 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:48.562836 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:48.577968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-773a4001-2818-4c49-9ecd-fd7ac83f7682 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.199433 Jun 21 19:04:48.581822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 124/244] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:48 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:49.594312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:49.595040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:49.601168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:49.601623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:49.602464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:49.602820 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:49.754044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:49.761732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9d0cb83e-3592-4b6d-b117-a9f6d3cbe02b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.171709 Jun 21 19:04:49.762256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 121/245] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:49 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:50.784161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:50.785569 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:50.787953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:50.794292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:50.794991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:50.795807 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:50.796254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:50.952365 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:50.960481 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b478c684-d0f6-48de-a899-45d6b0f43429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.180172 Jun 21 19:04:50.961299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 125/246] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:50 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:51.979856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:51.980478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:51.986816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:51.987276 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:51.988063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:51.988503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:52.132025 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:52.140265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-33612300-3398-4f14-b3c9-d3034bf28890 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.164983 Jun 21 19:04:52.140841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 122/247] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:51 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:53.157931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:53.158543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:53.164976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:53.165538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:53.166299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:53.166736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:53.314121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:53.322230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8cd96c4-9067-43eb-b731-f2a63b309593 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.168709 Jun 21 19:04:53.322810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 126/248] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:53 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:54.339951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:54.341038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:54.342647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:54.348827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:54.349316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:54.350094 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:54.350539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:54.505499 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:54.513718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4e13978e-5fae-474d-a1d6-1fce0f41546b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.177417 Jun 21 19:04:54.514843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 123/249] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:54 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:55.531503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:55.532114 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:55.538735 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:55.539181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:55.539943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:55.540376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:55.810387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:55.818354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-23e58b84-4d7e-4e8f-a1ca-87b62f22c2e2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.290757 Jun 21 19:04:55.818920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 127/250] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:55 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:56.835842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:56.837137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:56.839562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:04:56.846354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:56.847117 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:56.848324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:56.849056 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:56.995013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:57.002759 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b62f2f5-ea8c-4475-bc69-6e72f11aee90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1521 microversion: 2.1 time: 0.171218 Jun 21 19:04:57.003712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 124/251] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:56 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:04:58.020895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:58.021543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:58.028066 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:58.028517 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:58.029313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:58.030278 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:58.176826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:58.187940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8d4dd8e9-9311-404b-b5d5-f49dfda40dd0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1501 microversion: 2.1 time: 0.171654 Jun 21 19:04:58.188448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 128/252] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:58 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:04:58.204131 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:04:58.204748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:04:58.210902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:58.211351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:58.212312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:04:58.212753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:04:58.351608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:04:58.360791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-40a69b23-6ddd-48f2-b607-a450de101ec8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1515 microversion: 2.1 time: 0.160209 Jun 21 19:04:58.361566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 125/253] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:04:58 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:00.992919 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:00.994062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:01.008436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:01.010132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:01.011518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:01.015782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:01.052618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=77 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:01.057501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'flavor' on Instance uuid a342ffaa-5a3b-44f2-8bd6-309d7768b588 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:05:01.145886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d33bf61d-d42b-483e-859a-54aff082918d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/action" status: 200 len: 32 microversion: 2.1 time: 0.157885 Jun 21 19:05:01.146627 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 129/254] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:05:00 2022] POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:05:01.163902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:01.164534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:01.178256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:01.178722 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:01.181909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:01.182509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:01.486725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:01.494599 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-08fb853f-b5c0-434f-8058-d38cd8fcf0c6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.342471 Jun 21 19:05:01.495323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 126/255] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:01 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:02.512690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:02.513503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:02.520277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:02.520724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:02.521519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:02.521952 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:02.661565 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:02.669394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b8b023d7-00ad-49f3-9697-c52e036268d8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.161358 Jun 21 19:05:02.670001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 130/256] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:02 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:03.687425 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:03.688060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:03.694998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:03.696704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:03.696704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:03.696704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:03.862158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:03.869806 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6ccc67c-776b-4219-826f-3ac91be0c298 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.186903 Jun 21 19:05:03.870482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 127/257] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:03 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:04.886665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:04.887284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:04.894084 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:04.894346 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:04.895123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:04.895563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:05.037124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:05.044562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7fe058cb-8f35-42ce-9ea1-cc3252119fdc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.161772 Jun 21 19:05:05.045897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 131/258] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:04 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:06.062989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:06.063605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:06.070041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:06.070492 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:06.071252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:06.071686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:06.207426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:06.215004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4f198feb-4b11-42af-b350-db3f250ee90b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.156384 Jun 21 19:05:06.215908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 128/259] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:06 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:07.231832 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:07.232451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:07.238991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:07.239444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:07.240212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:07.240653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:07.374205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:07.381681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-09300357-61fc-4595-b702-fdf07bddbb2f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.153632 Jun 21 19:05:07.382415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 132/260] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:07 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:08.399242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:08.399845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:08.406419 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:08.406863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:08.407614 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:08.408050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:08.410683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=74 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:08.548442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:08.555984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9d4fcb7d-e413-4bd3-bf16-75aef528938c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.160557 Jun 21 19:05:08.556550 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 129/261] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:08 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:09.574361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:09.574983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:09.582592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:09.583058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:09.583842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:09.584283 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:09.723922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:09.731923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fd44f581-166e-4be7-ab21-4c95bd80443c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.161446 Jun 21 19:05:09.734362 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 133/262] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:09 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:10.750841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:10.751461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:10.757895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:10.758343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:10.759166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:10.759559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:10.891124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:10.898614 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-71d0229c-be1c-4638-a423-253729e068c7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.152265 Jun 21 19:05:10.899177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 130/263] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:10 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:11.915643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:11.916238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:11.923161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:11.923605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:11.924382 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:11.924812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:12.060888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:12.069162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-63b6ebe2-8d0f-482c-821d-796b51cc4859 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.157396 Jun 21 19:05:12.069657 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 134/264] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:11 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:13.086572 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:13.087189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:13.093809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:13.094260 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:13.095019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:13.095459 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:13.223077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:13.230684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8ef2454c-652a-4e27-9e80-8411aaf01245 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.147976 Jun 21 19:05:13.231252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 131/265] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:13 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:14.249153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:14.249792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:14.256145 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:14.256593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:14.257374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:14.257811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:14.399462 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:14.407319 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-88e7c22e-0e3a-4a3b-934c-de81b63cc74d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.162772 Jun 21 19:05:14.407912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 135/266] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:14 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:15.424749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:15.425394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:15.432407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:15.432837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:15.433630 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:15.434062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:15.572504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:15.580064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-55d06c64-ce0b-49bb-b048-717e4728f6c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.159102 Jun 21 19:05:15.580634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 132/267] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:15 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:16.597831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:16.598374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:16.605304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:16.605761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:16.606534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:16.606975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:16.751518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:16.758938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-461fa6b4-3f83-40b0-930b-2a2e79953ec2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.165064 Jun 21 19:05:16.759494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 136/268] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:16 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:17.775774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:17.776387 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:17.783029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:17.783486 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:17.784300 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:17.784745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:17.915873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:17.923349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f8c54c0c-7c2d-4e47-861d-b9a74843962b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.151427 Jun 21 19:05:17.923911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 133/269] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:17 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:18.397646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1616820741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006781389", "security_groups": [{"name": "tempest-secgroup-smoke-1224501279"}], "block_device_mapping_v2": [{"uuid": "be8fe84a-16cb-46a8-8ba2-f34a807192c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f86cc32-39a0-4e38-9448-e17d5262fa8d"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:18.541811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] validate_networks() for [('2f86cc32-39a0-4e38-9448-e17d5262fa8d', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:05:18.927543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:05:18.927969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:05:18.928447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:05:18.928864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:05:18.929324 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:05:18.939358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:18.939808 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:18.940902 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:18.941371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:18.942003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:18.942617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:18.948876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:18.949498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:18.950354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:18.950900 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:18.958631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:05:18.962788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for user 569256e6d1d1418eafb5ff2ed8909926 and project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:05:19.025009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:05:19.027254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be8fe84a-16cb-46a8-8ba2-f34a807192c8',volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:05:19.089340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:19.104100 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2c06ef15-d15c-4863-b39b-5f9bfd970884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.165699 Jun 21 19:05:19.105105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 134/270] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:18 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:19.180633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1c0f531e-4815-4024-a0eb-d6c315806240 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786753 Jun 21 19:05:19.181308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 137/271] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:05:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:05:19.192399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7b98c4be-f694-4b18-bd51-3bb67806b667 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:19.193039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7b98c4be-f694-4b18-bd51-3bb67806b667 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:19.256358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7b98c4be-f694-4b18-bd51-3bb67806b667 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:19.263184 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7b98c4be-f694-4b18-bd51-3bb67806b667 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1095 microversion: 2.1 time: 0.075064 Jun 21 19:05:19.264003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 135/272] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:19 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:20.131541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:20.132244 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:20.140128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:20.140745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:20.141623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:20.142082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:20.280391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:20.280944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:20.281073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:20.287440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:20.287894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:20.288674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:20.288789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d7241315-7622-4691-a3be-2ba4ef0def32 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.162024 Jun 21 19:05:20.289135 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:20.289407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 138/273] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:20 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:20.354617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:20.363064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-64aaceba-5c70-44c5-8506-9c58f39a07c9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1193 microversion: 2.1 time: 0.086618 Jun 21 19:05:20.363697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 136/274] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:20 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:21.306990 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:21.307617 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:21.310917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:21.333470 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.333931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.334734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.335169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.380548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:21.381760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:21.391866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.392257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.393068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.393533 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.472854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:21.483753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-609ea0a7-5975-4285-a200-c132f558db4c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1211 microversion: 2.1 time: 0.107737 Jun 21 19:05:21.484331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 137/275] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:21 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:21.537626 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:21.545618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2ea54029-d33c-489f-ae45-7e3ab27cacd3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1501 microversion: 2.1 time: 0.243243 Jun 21 19:05:21.546199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 139/276] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:21 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:21.563013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04537141-580e-437a-9c10-ee9eedc3df20"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:21.564139 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:21.570590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.571035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.571807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.572243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.598211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] HTTP exception thrown: Cannot 'attach_volume' instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 while it is in vm_state rescued Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Request method failure captured: Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/os-volume_attachments HTTP/1.1 Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 74 Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXfUWYtwzET13jYr4x56YwZuTLxo0CDv4HddLZc4o7eFmNzs1DxEKsJkkFVNRXCAy82jPr_KMvFBaBt63-ltRvZO7EorHFSRyGcA_wU0CcdnaPEZk1P_JVdSQIWJTV2-2GQHj_5MXCoWd_4qF7TOQ1jc-BTKFhSGapYk2B9Hk4i6kE Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:05:21.600338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}] Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: eeafe22d22f648d6aefcc6a308d4fc0d Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {"volumeAttachment": {"volumeId": "04537141-580e-437a-9c10-ee9eedc3df20"}} Jun 21 19:05:21.601859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Cannot 'attach_volume' instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 while it is in vm_state rescued Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': 'a342ffaa-5a3b-44f2-8bd6-309d7768b588', 'body': {'volumeAttachment': {'volumeId': '04537141-580e-437a-9c10-ee9eedc3df20'}}} Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:05:21.602687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 while it is in vm_state rescued Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:05:21.604115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 while it is in vm_state rescued Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Returning 409 to user: Cannot 'attach_volume' instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 while it is in vm_state rescued {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:05:21.605435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-145788dd-e267-4c34-86f1-4bc3cd7d7175 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043287 Jun 21 19:05:21.608102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 138/277] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:05:21 2022] POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 19:05:21.611353 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:21.611892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:21.618188 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.618638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.619415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.619850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.697265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6a458f4d-183c-42fd-b26b-54afce6cbfe4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/action" status: 202 len: 0 microversion: 2.1 time: 0.089542 Jun 21 19:05:21.698337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 140/278] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:05:21 2022] POST /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:05:21.706702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:21.707631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:21.714023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.714832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.715715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:21.716286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:21.852617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:21.860151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e630067d-602f-4f35-b7e5-6fd87adbd7bb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.157510 Jun 21 19:05:21.860722 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 139/279] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:21 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:22.502662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:22.503304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:22.509710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:22.510154 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:22.510998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:22.511397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:22.625558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:22.633634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d7774643-cca6-4862-abe0-a4d2e6f341fc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1211 microversion: 2.1 time: 0.136435 Jun 21 19:05:22.634215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 141/280] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:22 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1211 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:22.877824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:22.879165 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:22.885673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:22.886418 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:22.887385 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:22.888021 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:23.064255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:23.072374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-af03a7d3-63f8-4036-b309-3aa3ab610751 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.198505 Jun 21 19:05:23.072951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 140/281] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:22 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:23.649847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:23.650463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:23.656853 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:23.657334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:23.658096 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:23.658533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:23.795007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:23.802948 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b78ef3d-44fa-47a5-8569-3cfd16f0f0c2 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1279 microversion: 2.1 time: 0.156837 Jun 21 19:05:23.803558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 142/282] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:23 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:24.092422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:24.093348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:24.101705 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:24.102273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:24.103388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:24.103861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:24.614606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:24.623897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6a4dc3f9-6654-4d00-81c9-b37d3f2c0f20 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.535841 Jun 21 19:05:24.637158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 141/283] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:24 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:24.820201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:24.820959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:24.827465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:24.827910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:24.828679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:24.829133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:24.844021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:25.043870 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:25.053018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a3c25c03-36d5-4fb0-a51a-d6ae1abbc6dd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1279 microversion: 2.1 time: 0.236627 Jun 21 19:05:25.053958 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 143/284] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:24 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:25.260041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-fb3b0021-04cc-49df-a786-9e62e4adb94b req-15cb6f3f-4189-402e-878a-acb2bc72bae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a160e9-aeee-4070-b1e2-b21fe7d01849", "tag": "5d024db7-613f-4299-973b-fe026f018148"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:25.269545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fb3b0021-04cc-49df-a786-9e62e4adb94b req-15cb6f3f-4189-402e-878a-acb2bc72bae7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:25.270583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-fb3b0021-04cc-49df-a786-9e62e4adb94b req-15cb6f3f-4189-402e-878a-acb2bc72bae7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:25.287774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-fb3b0021-04cc-49df-a786-9e62e4adb94b req-15cb6f3f-4189-402e-878a-acb2bc72bae7 service nova] Creating event network-changed:5d024db7-613f-4299-973b-fe026f018148 for instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 on hv-cinder-84630 Jun 21 19:05:25.293003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-fb3b0021-04cc-49df-a786-9e62e4adb94b req-15cb6f3f-4189-402e-878a-acb2bc72bae7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Jun 21 19:05:25.293678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 142/285] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:05:25.650751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:25.651298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:25.657465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:25.657912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:25.658677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:25.659108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:26.072266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:26.073181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:26.079585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:26.079956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:26.080752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:26.081220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:26.098425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:26.108527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d58aa5b2-9e09-4456-8e78-cfad40782429 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.461648 Jun 21 19:05:26.109308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 144/286] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:25 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:26.432421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:26.440839 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8f43a754-22ab-4d4f-b486-78352fb12ce0 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1279 microversion: 2.1 time: 0.373158 Jun 21 19:05:26.441714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 143/287] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:26 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1279 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:27.127093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:27.127661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:27.134334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:27.134790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:27.135575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:27.136017 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:27.271400 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:27.279511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4c11fca0-99f3-4ddc-892f-2fc979b89e9b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.157176 Jun 21 19:05:27.280088 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 145/288] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:27 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:27.457703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:27.458307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:27.460234 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=42 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:27.465573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:27.466512 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:27.467269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:27.467700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:27.605289 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:27.613462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f91951c-11fb-4e67-8d2e-57fd06a6e956 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1279 microversion: 2.1 time: 0.159536 Jun 21 19:05:27.614077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 144/289] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:27 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:28.296507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:28.297032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:28.303987 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:28.304442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:28.305279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:28.305719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:28.481037 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:28.491837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f0124f0-8368-40d1-be71-2528655aa6d6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.199312 Jun 21 19:05:28.492635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 146/290] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:28 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:28.633623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:28.634501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:28.641568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:28.642015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:28.642792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:28.643534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:28.790032 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:28.798824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-64bcfaea-fd55-4ff4-af26-3d97c6009436 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1279 microversion: 2.1 time: 0.170613 Jun 21 19:05:28.799624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 145/291] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:28 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:29.511661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:29.512491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:29.514483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:29.515233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:29.521886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:29.522340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:29.523133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:29.523578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:29.709861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:29.726966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-49b14895-0a80-4de2-b36f-d44dcf0ffc02 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1509 microversion: 2.1 time: 0.213951 Jun 21 19:05:29.731300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 147/292] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:29 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:29.818430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:29.819021 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:29.820889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:29.827231 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:29.827725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:29.828640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:29.829244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:29.995123 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:30.004491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1ad719e1-7c61-42ea-a9e4-ff6e0d67bba4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.190400 Jun 21 19:05:30.005302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 146/293] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:29 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:30.741430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:30.742512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:30.751211 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:30.751816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:30.753047 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:30.753526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:30.943016 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:30.960235 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-572e05ac-89c6-42df-92d4-c57f78562658 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1515 microversion: 2.1 time: 0.224638 Jun 21 19:05:30.961290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 148/294] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:30 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:31.025884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:31.027092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:31.033757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:31.034233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:31.035096 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:31.035899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:31.209918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:31.212374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:31.224482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0f889531-5cbf-48ba-bc35-916deccbd902 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.204419 Jun 21 19:05:31.225521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 147/295] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:31 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:32.244188 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:32.245586 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:32.257608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:32.257608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:32.257850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:32.258172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:32.422642 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7d225ffb-00c1-4310-8e84-c87a6c22c04e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: .version_select at 0x7f3595a879d0>, body: {"keypair": {"name": "tempest-keypair-1313405296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv/7Te7mQ7q+Xm6DQu3HfFls4fbjYZqzXwC1cbkqT/k1zjzPr3ep6X2KXW/lVgaluDO5x/Z+Y0WIsTEkjUOseB5SyNWeAn0wKy8a1UTeNIMTtgaV7OaiTkPIuIQyTw6cg=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:32.452464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7d225ffb-00c1-4310-8e84-c87a6c22c04e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for project f1af5239143346e8b995f4176d78ca4d. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:05:32.459315 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-7d225ffb-00c1-4310-8e84-c87a6c22c04e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for user eeafe22d22f648d6aefcc6a308d4fc0d and project f1af5239143346e8b995f4176d78ca4d. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:05:32.460002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:32.471053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5aa4f34e-36d5-4e86-b8cc-3ff94b681f7e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.232130 Jun 21 19:05:32.472113 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 149/296] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:32 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:32.517674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7d225ffb-00c1-4310-8e84-c87a6c22c04e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106951 Jun 21 19:05:32.522310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 148/297] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:05:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:05:33.492295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:33.493138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:33.507737 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:33.508197 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:33.509002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:33.509471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:33.724713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:33.747484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9d50577-63ad-4f0c-b3af-9a3bd0775c98 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.257844 Jun 21 19:05:33.748345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 150/298] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:33 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:34.603591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2107989246", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a8eeb6c-3369-45e7-8289-8683fe906e2b"}], "security_groups": [{"name": "tempest-securitygroup--2140470709"}], "key_name": "tempest-keypair-1313405296", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:34.724011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] validate_networks() for [('5a8eeb6c-3369-45e7-8289-8683fe906e2b', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:05:34.765304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:34.766151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:34.774556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:34.775102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:34.775993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:34.776660 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:35.001388 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:35.010934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a2254072-2dda-4ad9-b6f1-4b0bf9933081 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.250341 Jun 21 19:05:35.015090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 151/299] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:34 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:35.245047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:05:35.245527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:05:35.246041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:05:35.246500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:05:35.246936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:05:35.261760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:35.263055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:35.264837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:35.265440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:35.288392 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:05:35.294170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Getting quotas for user eeafe22d22f648d6aefcc6a308d4fc0d and project f1af5239143346e8b995f4176d78ca4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:05:35.307859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:05:35.311318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:05:35.382088 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0f1803bc-67e2-405f-a44a-a2a30e12dcc0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.784444 Jun 21 19:05:35.388964 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 149/300] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:05:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:05:35.396430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-423e9fce-6041-499e-b2ca-27c8ec47ee2c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:35.397453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-423e9fce-6041-499e-b2ca-27c8ec47ee2c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:35.500475 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-423e9fce-6041-499e-b2ca-27c8ec47ee2c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:35.509880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-423e9fce-6041-499e-b2ca-27c8ec47ee2c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1246 microversion: 2.1 time: 0.119344 Jun 21 19:05:35.510884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 152/301] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:35 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:36.030737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:36.031463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:36.040801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:36.041349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:36.042689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:36.043243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:36.221178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:36.229946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c8979bb2-257f-43e3-adab-2fc59d3e1194 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.203870 Jun 21 19:05:36.230897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 150/302] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:36 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:36.531805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:36.532685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:36.540416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:36.540868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:36.542539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:36.542539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:36.640345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:36.658847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-88fae198-a023-4359-bf5e-8127533b57cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1250 microversion: 2.1 time: 0.132701 Jun 21 19:05:36.659922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 153/303] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:36 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1250 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:37.247940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:37.248488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:37.255069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:37.255528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:37.256312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:37.256751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:37.427593 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:37.440078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-30e47446-313c-496b-90fa-535151ade887 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.195685 Jun 21 19:05:37.441297 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 151/304] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:37 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:37.684208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:37.684910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:37.700447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:37.700920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:37.702104 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:37.702379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:37.795220 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:37.803795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-69686e83-3774-4c40-8e5e-23ae97a6c85e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1250 microversion: 2.1 time: 0.129052 Jun 21 19:05:37.804691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 154/305] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:37 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1250 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:38.459386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:38.460769 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:38.467036 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:38.467587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:38.468447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:38.468960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:38.625737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:38.633865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fbb0ce14-130b-42ba-9ca2-9e207eb4afd6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.178477 Jun 21 19:05:38.634510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 152/306] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:38 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:38.820643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:38.821302 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:38.833759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:38.833759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:38.834208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:38.834910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:38.945511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:38.954835 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df5db5b6-2c50-4326-b391-58c56f2eb997 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1250 microversion: 2.1 time: 0.137892 Jun 21 19:05:38.956494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 155/307] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:38 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1250 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:39.651083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:39.651634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:39.657575 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:39.658266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:39.663024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:39.663024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:39.815021 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:39.826296 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1de567dc-2afa-4ef4-8abd-198902c07abc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.178921 Jun 21 19:05:39.827106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 153/308] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:39 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:39.974981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:39.975699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:39.985390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:39.985851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:39.986643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:39.987079 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:40.106486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:40.161801 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bd09270b-6f75-4ba0-8c9c-5eec586af1c0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1250 microversion: 2.1 time: 0.190135 Jun 21 19:05:40.164309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 156/309] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:39 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1250 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:40.855589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:40.856861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:40.876978 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:40.881251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:40.882787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:40.883443 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:41.183945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:41.184936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:41.197751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:41.198551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:41.200014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:41.200751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:41.347760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:41.357830 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-37ad6067-1ff5-45cc-87aa-01b88621182d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1306 microversion: 2.1 time: 0.180370 Jun 21 19:05:41.367285 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 157/310] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:41 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:41.373216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:41.383125 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-161627da-eac2-44fb-b006-2f8702916679 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.538763 Jun 21 19:05:41.384025 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 154/311] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:40 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:42.375077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:42.375614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:42.384950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:42.385920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:42.386712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:42.387733 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:42.401078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:42.401768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:42.409811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:42.410259 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:42.411073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:42.411547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:42.538199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:42.548588 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b2da2eb4-d695-4edb-8012-be40f7a9cfb0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1304 microversion: 2.1 time: 0.177758 Jun 21 19:05:42.549180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 158/312] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:42 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:42.721869 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:42.731490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-21d27a73-f3c6-43b2-abb8-4ff851e49bf6 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.334564 Jun 21 19:05:42.740841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 155/313] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:42 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:43.566385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:43.569452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:43.580589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:43.584016 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:43.592203 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:43.592856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:43.718072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:43.729861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5e4ca13-55fa-439f-a7ed-4bee2ada27a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1304 microversion: 2.1 time: 0.166622 Jun 21 19:05:43.740699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 159/314] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:43 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:43.748648 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:43.749294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:43.762925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:43.763378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:43.764164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:43.764776 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:44.043752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:44.056179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-58e842a8-d7e8-4296-8441-524352c1b110 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.311808 Jun 21 19:05:44.056795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 156/315] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:43 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:44.747760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:44.748380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:44.765409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:44.766128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:44.767130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:44.767728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:44.907531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:44.915764 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-37f04cfa-afca-4ef3-a895-de44b3576dae tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1304 microversion: 2.1 time: 0.172304 Jun 21 19:05:44.916348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 160/316] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:44 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:45.076871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:45.078723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:45.089639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:45.090141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:45.090984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:45.091430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:45.278370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:45.302132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=10 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:45.521011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:45.557166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7c97b93b-76be-4832-b59b-1c3ef1663046 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.474409 Jun 21 19:05:45.557897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 157/317] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:45 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:45.934574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:45.935201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:45.939076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:45.955411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:45.956125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:45.957082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:45.957697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:46.007659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:46.216583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:46.228488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9c5e7f47-da71-411f-a265-33b87cfd78a9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.297001 Jun 21 19:05:46.229113 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 161/318] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:45 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:46.580259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:46.581687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:46.591141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:46.591840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:46.605031 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:46.607989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:46.622959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2d654f12-ef29-4f65-bfba-b2fb9a7baedf tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Action: 'create', calling method: .version_select at 0x7f3595ae9940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1860756024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk6XCgtnQcx2juJT2tiGqMIBIXEHirE7XTdL4dqrYIZ26w3as+Ovsy7KnzO3ba3lwjTivIjvTA6oinWhcLwE+0zagoeFvCsmnuGa+aMMfoDTU1J4SkLV+YN4bB7he0T2g=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:46.655078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-2d654f12-ef29-4f65-bfba-b2fb9a7baedf tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Getting quotas for project 4202625ef50b44de9a96563feb874a5a. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:05:46.665236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-2d654f12-ef29-4f65-bfba-b2fb9a7baedf tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Getting quotas for user c19aa025ff3046229cf0b8041058285e and project 4202625ef50b44de9a96563feb874a5a. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:05:46.704610 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2d654f12-ef29-4f65-bfba-b2fb9a7baedf tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.392250 Jun 21 19:05:46.705995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 158/319] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:05:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:05:46.920732 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:46.934650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fc9f8a38-0b07-4149-9626-93e29bb035ec tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.363598 Jun 21 19:05:46.935747 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 162/320] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:46 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:47.249697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:47.250891 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:47.259886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.260484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:47.261388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.261967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:47.320023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-a2bf42d7-5107-4e2b-baaa-9dc40a2622cb req-d6a506d9-06de-4acc-9d04-cc7c708d683a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:47.351770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a2bf42d7-5107-4e2b-baaa-9dc40a2622cb req-d6a506d9-06de-4acc-9d04-cc7c708d683a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.353368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-a2bf42d7-5107-4e2b-baaa-9dc40a2622cb req-d6a506d9-06de-4acc-9d04-cc7c708d683a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:47.372698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-a2bf42d7-5107-4e2b-baaa-9dc40a2622cb req-d6a506d9-06de-4acc-9d04-cc7c708d683a service nova] Creating event network-changed:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:05:47.403528 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-a2bf42d7-5107-4e2b-baaa-9dc40a2622cb req-d6a506d9-06de-4acc-9d04-cc7c708d683a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093851 Jun 21 19:05:47.404469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 163/321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:05:47.620549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-da836d73-22a5-4ba3-85af-31650e6062a9 req-b4e9b4a3-52e3-430c-bd6f-398cb7a7a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a160e9-aeee-4070-b1e2-b21fe7d01849", "name": "network-vif-plugged", "status": "completed", "tag": "5d024db7-613f-4299-973b-fe026f018148"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:47.667549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-da836d73-22a5-4ba3-85af-31650e6062a9 req-b4e9b4a3-52e3-430c-bd6f-398cb7a7a2a1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.674187 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-da836d73-22a5-4ba3-85af-31650e6062a9 req-b4e9b4a3-52e3-430c-bd6f-398cb7a7a2a1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:47.727862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-da836d73-22a5-4ba3-85af-31650e6062a9 req-b4e9b4a3-52e3-430c-bd6f-398cb7a7a2a1 service nova] Creating event network-vif-plugged:5d024db7-613f-4299-973b-fe026f018148 for instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 on hv-cinder-84630 Jun 21 19:05:47.737646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-da836d73-22a5-4ba3-85af-31650e6062a9 req-b4e9b4a3-52e3-430c-bd6f-398cb7a7a2a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143684 Jun 21 19:05:47.738689 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 164/322] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:05:47.882530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:47.899010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-08c50c51-d8ab-4109-92bd-e0e12779760e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.656398 Jun 21 19:05:47.914130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 159/323] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:47 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:47.952909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:47.953794 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:47.961695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.962393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:47.963710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:47.964488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:48.140863 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:48.149112 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d6b0b09f-620e-4c3a-a7db-6d7166045f56 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.200599 Jun 21 19:05:48.149687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 165/324] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:47 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:05:48.924922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:48.925566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:48.935454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:48.935909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:48.936850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:48.937473 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:49.157513 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:49.167068 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:49.167593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:49.183370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c9e48ff7-c840-483c-a1ba-f0226685a48c tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.261439 Jun 21 19:05:49.184604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 160/325] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:48 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:49.195399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:49.195399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:49.195399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:49.197910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:49.457297 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:49.465921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4eafb318-df9c-4985-a536-06ac0781839c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.302999 Jun 21 19:05:49.475707 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 166/326] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:49 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:50.205774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:50.206503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:50.212592 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:50.213046 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:50.213847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:50.214283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:50.359837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:50.369002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f7b8c9b9-a325-43ba-91d6-6c10a271b02a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.171149 Jun 21 19:05:50.378894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 161/327] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:50 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:50.482974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:50.483736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:50.491062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:50.491800 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:50.495445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:50.496540 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:50.639402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:50.647083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e91cdb08-fcac-45f4-a068-b911c0865a9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.167928 Jun 21 19:05:50.647662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 167/328] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:50 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:51.385981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:51.386682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:51.392756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:51.393240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:51.394043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:51.394480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:51.553242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:51.561240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-300ed4c0-09ab-42aa-a2e1-0653e02bebb6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.178978 Jun 21 19:05:51.561819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 162/329] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:51 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:51.670125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:51.670125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:51.678930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=60 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:51.686237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:51.686954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:51.687924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:51.688516 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:51.853185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:51.863376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1872f4cd-26a9-464e-8f6c-40cf212620a1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.203140 Jun 21 19:05:51.863946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 168/330] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:51 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:52.586493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:52.587812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:52.594398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:52.594951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:52.595833 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:52.596393 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:52.748196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:52.762336 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f43ff398-ae63-43f7-814a-cb91a647d44a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.179185 Jun 21 19:05:52.763332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 163/331] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:52 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:52.880308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:52.881650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:52.889008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:52.889803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:52.890630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:52.891078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:53.342504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:53.351522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-97eab6c1-d752-496e-855e-0a08f596cb0b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1267 microversion: 2.1 time: 0.475084 Jun 21 19:05:53.352267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 169/332] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:52 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1267 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:53.779123 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:53.779732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:53.787046 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:53.787585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:53.788478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:53.788967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:54.026047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:54.034176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2340ce2c-52cc-46e1-97f4-983b42e26315 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.258975 Jun 21 19:05:54.034862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 164/333] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:53 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:54.368505 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:54.369137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:54.377010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:54.377234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:54.378023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:54.378460 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:54.555438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:54.569674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d2a86b48-09f9-4720-95f4-320a98179099 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1454 microversion: 2.1 time: 0.200535 Jun 21 19:05:54.571033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 170/334] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:54 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:54.591534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:54.592194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:54.600857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:54.601613 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:54.602435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:54.602879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:54.750943 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:54.758612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f9374b65-10f0-4c09-8ebd-f67ac413b1ea tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1454 microversion: 2.1 time: 0.171306 Jun 21 19:05:54.759556 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 165/335] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:54 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:55.052165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:55.053122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:55.059665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:55.060342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:55.061378 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:55.061812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:55.310931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:55.334740 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d0ad0ffe-0723-4417-9736-815ad33667f3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.286496 Jun 21 19:05:55.335338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 171/336] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:55 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:55.529685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-2d6e3f3a-fd45-4aa2-ac76-a649a4fd7fef req-9f072398-5cd6-4a17-ab14-3e33465aa0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "name": "network-vif-plugged", "status": "completed", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:55.548173 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2d6e3f3a-fd45-4aa2-ac76-a649a4fd7fef req-9f072398-5cd6-4a17-ab14-3e33465aa0d8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:55.550798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2d6e3f3a-fd45-4aa2-ac76-a649a4fd7fef req-9f072398-5cd6-4a17-ab14-3e33465aa0d8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:55.577661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-2d6e3f3a-fd45-4aa2-ac76-a649a4fd7fef req-9f072398-5cd6-4a17-ab14-3e33465aa0d8 service nova] Creating event network-vif-plugged:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:05:55.588102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-2d6e3f3a-fd45-4aa2-ac76-a649a4fd7fef req-9f072398-5cd6-4a17-ab14-3e33465aa0d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062636 Jun 21 19:05:55.589193 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 166/337] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:05:56.353770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:56.355014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:56.362279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:56.362734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:56.363521 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:56.363993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:56.615765 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:56.624972 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9f30b3f3-88b2-43a4-bfaa-d1e69b210619 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.275924 Jun 21 19:05:56.625819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 172/338] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:56 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:57.083059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-4f85468b-2093-41c6-85c3-d6d3296ad81a req-fe44f0fd-d7f8-48c0-862e-906a523ddd3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a160e9-aeee-4070-b1e2-b21fe7d01849", "tag": "5d024db7-613f-4299-973b-fe026f018148"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:05:57.086765 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:57.093577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4f85468b-2093-41c6-85c3-d6d3296ad81a req-fe44f0fd-d7f8-48c0-862e-906a523ddd3e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:57.094013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4f85468b-2093-41c6-85c3-d6d3296ad81a req-fe44f0fd-d7f8-48c0-862e-906a523ddd3e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:57.105011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-4f85468b-2093-41c6-85c3-d6d3296ad81a req-fe44f0fd-d7f8-48c0-862e-906a523ddd3e service nova] Creating event network-changed:5d024db7-613f-4299-973b-fe026f018148 for instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 on hv-cinder-84630 Jun 21 19:05:57.110164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-4f85468b-2093-41c6-85c3-d6d3296ad81a req-fe44f0fd-d7f8-48c0-862e-906a523ddd3e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031323 Jun 21 19:05:57.111086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 167/339] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:05:57.642602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:57.643219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:57.651589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:57.652719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:57.653753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:57.654197 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:57.824924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:57.833002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9d5a08bb-c9e1-422f-9a9f-947fc00cc5e8 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1372 microversion: 2.1 time: 0.194143 Jun 21 19:05:57.853754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 173/340] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:57 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:58.867598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:58.868407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:58.870522 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:58.877440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:58.878119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:58.878666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:58.879129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:58.896091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:05:59.032401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:05:59.041500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5e885dc0-c8ba-42e7-8e5b-c8bda998da96 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1565 microversion: 2.1 time: 0.178099 Jun 21 19:05:59.042085 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 168/341] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:05:58 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:05:59.057864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:05:59.059165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:05:59.065978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:59.066430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:59.067198 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:05:59.067681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:05:59.165373 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c85d1f23-7a41-414f-b9d3-fb1c8e0e7c90 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111356 Jun 21 19:05:59.165988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 174/342] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:05:59 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:00.406909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-462cf216-85c1-4b5f-8af7-5131790d70ba req-e9d54e57-213e-4ea5-87e7-1f861fc9abe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:00.415956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-462cf216-85c1-4b5f-8af7-5131790d70ba req-e9d54e57-213e-4ea5-87e7-1f861fc9abe0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:00.416680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-462cf216-85c1-4b5f-8af7-5131790d70ba req-e9d54e57-213e-4ea5-87e7-1f861fc9abe0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:00.429222 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-462cf216-85c1-4b5f-8af7-5131790d70ba req-e9d54e57-213e-4ea5-87e7-1f861fc9abe0 service nova] Creating event network-changed:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:06:00.439506 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-462cf216-85c1-4b5f-8af7-5131790d70ba req-e9d54e57-213e-4ea5-87e7-1f861fc9abe0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037713 Jun 21 19:06:00.440101 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 169/343] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:06.850452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-396419048", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "networks": [{"uuid": "efffd005-1431-44f7-ab80-b744d0526f8f"}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:06.901438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] validate_networks() for [('efffd005-1431-44f7-ab80-b744d0526f8f', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:06:07.252584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:06:07.253005 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:06:07.253506 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:06:07.253916 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:06:07.254325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:06:07.263251 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:07.263637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:07.264427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:07.264856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:07.283368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Getting quotas for project 3ede6086ad76404a8ad65f0525ac4a53. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:06:07.287443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Getting quotas for user 6af4701349d44699a8f04e1c8313de9e and project 3ede6086ad76404a8ad65f0525ac4a53. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:06:07.298155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:06:07.300388 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:06:07.346116 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8fe5b8a1-31d6-43fd-b998-23c80e873b6e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500096 Jun 21 19:06:07.351625 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 175/344] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:06:07.357561 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0e1ee9ca-9eec-4cc4-b0fa-c05a46fce906 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:07.358266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0e1ee9ca-9eec-4cc4-b0fa-c05a46fce906 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:07.413662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0e1ee9ca-9eec-4cc4-b0fa-c05a46fce906 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:07.420208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0e1ee9ca-9eec-4cc4-b0fa-c05a46fce906 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1213 microversion: 2.1 time: 0.067092 Jun 21 19:06:07.420773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 170/345] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:07 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:08.437755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:08.439029 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:08.454266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:08.454791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:08.455637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:08.456143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:08.536730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:08.545951 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2e11679c-290a-44e7-99e4-3d47f797a4d4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1283 microversion: 2.1 time: 0.112276 Jun 21 19:06:08.547652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 176/346] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:08 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:09.565199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:09.566010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:09.572103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:09.572548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:09.573352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:09.573781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:09.782562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:09.790161 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-08a023c2-19de-4855-8a37-be8b0c7f846f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.228871 Jun 21 19:06:09.791102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 171/347] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:09 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:09.805892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-955d124d-a67f-457c-9c86-1e18f21cf2fa req-92c3851c-82f0-44bd-a59a-a01dc788fa87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e", "tag": "bf35a8d1-293f-4a9e-9473-b8c54400468a"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:09.818075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-955d124d-a67f-457c-9c86-1e18f21cf2fa req-92c3851c-82f0-44bd-a59a-a01dc788fa87 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:09.818263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-955d124d-a67f-457c-9c86-1e18f21cf2fa req-92c3851c-82f0-44bd-a59a-a01dc788fa87 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:09.840880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-955d124d-a67f-457c-9c86-1e18f21cf2fa req-92c3851c-82f0-44bd-a59a-a01dc788fa87 service nova] Creating event network-changed:bf35a8d1-293f-4a9e-9473-b8c54400468a for instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e on hv-cinder-84630 Jun 21 19:06:09.847450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-955d124d-a67f-457c-9c86-1e18f21cf2fa req-92c3851c-82f0-44bd-a59a-a01dc788fa87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045312 Jun 21 19:06:09.848249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 177/348] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:10.807612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:10.808207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:10.814370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:10.814824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:10.815847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:10.816282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:10.943182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:10.951039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e25fa9d2-7269-4d4a-9036-98018a51c7e2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.147262 Jun 21 19:06:10.951629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 172/349] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:10 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:11.968649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:11.969374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:11.976735 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:11.977210 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:11.977986 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:11.978427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:12.127127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:12.135102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-946e865a-a83d-4447-b4eb-da8373507964 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.170683 Jun 21 19:06:12.135660 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 178/350] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:11 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:13.151676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:13.152292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:13.158800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:13.159245 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:13.160006 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:13.160436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:13.291084 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:13.298559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-153df359-c165-411b-be28-d9a4b6f8fb9d tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.150787 Jun 21 19:06:13.299128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 173/351] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:13 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:13.435673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:06:13.436263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:06:14.315894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:14.316508 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:14.323176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:14.323630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:14.324869 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:14.324869 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:14.454922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:14.462193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4e8bca19-340a-458b-8cc9-137b204c1ff6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.151176 Jun 21 19:06:14.462739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 179/352] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:14 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:15.479206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:15.479815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:15.486483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:15.486920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:15.487678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:15.488103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:15.638062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:15.646611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9c8e29f8-303d-416b-a7bc-bf76c6203131 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.171122 Jun 21 19:06:15.647706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 174/353] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:15 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:16.663705 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:16.664223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:16.670613 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:16.671056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:16.671821 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:16.672256 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:16.674784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=96 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:16.799055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:16.806485 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e96a10be-28fe-47c8-8b3a-fcc54d7dd5d8 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.146755 Jun 21 19:06:16.807039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 180/354] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:16 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:17.824583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:17.825189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:17.827299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:17.833457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:17.833907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:17.834685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:17.835120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:17.971680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:17.979116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-db0d5093-ee83-4a5c-b4c7-c8c9a5d46756 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.158518 Jun 21 19:06:17.979685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 175/355] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:17 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:18.997433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:18.998453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:19.000614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:19.001509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:19.009512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:19.010023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:19.010762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:19.011233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:19.157283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-53ce5a3c-53f8-4752-a676-3289804b093d req-3aa68afd-a39f-49ce-8093-4e311df46a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e", "name": "network-vif-plugged", "status": "completed", "tag": "bf35a8d1-293f-4a9e-9473-b8c54400468a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:19.174492 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-53ce5a3c-53f8-4752-a676-3289804b093d req-3aa68afd-a39f-49ce-8093-4e311df46a97 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:19.175257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-53ce5a3c-53f8-4752-a676-3289804b093d req-3aa68afd-a39f-49ce-8093-4e311df46a97 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:19.231009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:19.245338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e2a1429d-7015-4c79-84fb-819634180a98 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.252610 Jun 21 19:06:19.246360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 181/356] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:18 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:19.349764 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-53ce5a3c-53f8-4752-a676-3289804b093d req-3aa68afd-a39f-49ce-8093-4e311df46a97 service nova] Creating event network-vif-plugged:bf35a8d1-293f-4a9e-9473-b8c54400468a for instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e on hv-cinder-84630 Jun 21 19:06:19.354849 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-53ce5a3c-53f8-4752-a676-3289804b093d req-3aa68afd-a39f-49ce-8093-4e311df46a97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205911 Jun 21 19:06:19.355441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 176/357] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:06:20.265245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:20.265919 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:20.273367 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:20.273855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:20.274728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:20.275200 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:20.441150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:20.449132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-38482370-c375-47aa-aa20-1d6f0c5a3885 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.187886 Jun 21 19:06:20.449810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 182/358] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:20 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:21.467194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:21.467898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:21.474872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:21.475469 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:21.476280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:21.476931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:21.661311 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:21.672385 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2f2cb5f9-0f4f-4361-9a06-dc5b8c3e51e9 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1313 microversion: 2.1 time: 0.209047 Jun 21 19:06:21.673396 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 177/359] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:21 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:22.691268 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:22.692062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:22.696340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:22.701375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:22.701943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:22.703340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:22.703822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:22.852934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:22.861798 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3a2265a7-17b6-43fe-8cc4-63d491e20fa4 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1497 microversion: 2.1 time: 0.175225 Jun 21 19:06:22.862403 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 183/360] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:22 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:23.364499 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:23.365430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:23.376074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:23.376689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:23.377860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:23.378497 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:23.415924 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:06:23.522039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2b879a91-a475-4177-be32-f6ecdd8caaf6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 204 len: 0 microversion: 2.1 time: 0.164933 Jun 21 19:06:23.522950 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 178/361] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:06:23 2022] DELETE /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:06:23.532856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:23.533524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:23.540090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:23.540572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:23.541401 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:23.542501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:23.704116 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:23.714320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f4315049-bd50-4be6-ae8a-1d6afc48ff5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1503 microversion: 2.1 time: 0.185724 Jun 21 19:06:23.715370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 184/362] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:23 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:24.735325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:24.736145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:24.743572 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:24.744053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:24.745126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:24.745760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:24.947808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:24.956378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-00a64e64-e1d3-4577-8238-295cfc68dd8e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1503 microversion: 2.1 time: 0.225922 Jun 21 19:06:24.957503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 179/363] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:24 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:25.312726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-823033861", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1860756024", "security_groups": [{"name": "tempest-secgroup-smoke-1148022578"}], "networks": [{"uuid": "6bc865c0-d82a-4200-86e8-db3fe58c7613"}], "block_device_mapping_v2": [{"uuid": "015c04fb-7f52-4bee-9e4d-6271e7afa7fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:25.461079 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] validate_networks() for [('6bc865c0-d82a-4200-86e8-db3fe58c7613', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:06:25.975115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:25.975739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:25.982546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:25.982998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:25.984396 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:25.984859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:26.381909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:26.390587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cee577fd-7485-41eb-9dc7-e3c4d7fde0b3 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1503 microversion: 2.1 time: 0.419247 Jun 21 19:06:26.391174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 180/364] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:25 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:26.494493 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:06:26.495275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:06:26.496170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:06:26.496878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:06:26.497680 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:06:26.514002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:26.514767 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:26.516371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:26.517209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:26.551875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Getting quotas for project 4202625ef50b44de9a96563feb874a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:06:26.559990 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Getting quotas for user c19aa025ff3046229cf0b8041058285e and project 4202625ef50b44de9a96563feb874a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:06:26.641192 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:06:26.643405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='015c04fb-7f52-4bee-9e4d-6271e7afa7fe',volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:06:26.809652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-10fd4488-1d1b-4972-a900-2a85f6fba1c5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505288 Jun 21 19:06:26.810417 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 185/365] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:06:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:06:26.831901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ee2bd9b2-c534-41f6-8113-a8bf67df8e82 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:26.833318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ee2bd9b2-c534-41f6-8113-a8bf67df8e82 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:26.863433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-24baf7f1-b640-4d42-840c-d544c9830df2 req-fcddff23-f014-4591-bd74-4e0083625f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e", "name": "network-vif-deleted", "tag": "bf35a8d1-293f-4a9e-9473-b8c54400468a"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:26.880474 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-24baf7f1-b640-4d42-840c-d544c9830df2 req-fcddff23-f014-4591-bd74-4e0083625f40 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:26.881492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-24baf7f1-b640-4d42-840c-d544c9830df2 req-fcddff23-f014-4591-bd74-4e0083625f40 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:26.904820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-24baf7f1-b640-4d42-840c-d544c9830df2 req-fcddff23-f014-4591-bd74-4e0083625f40 service nova] Creating event network-vif-deleted:bf35a8d1-293f-4a9e-9473-b8c54400468a for instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e on hv-cinder-84630 Jun 21 19:06:26.916488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-24baf7f1-b640-4d42-840c-d544c9830df2 req-fcddff23-f014-4591-bd74-4e0083625f40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059105 Jun 21 19:06:26.917962 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 186/366] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:26.938031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ee2bd9b2-c534-41f6-8113-a8bf67df8e82 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:26.948655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ee2bd9b2-c534-41f6-8113-a8bf67df8e82 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1088 microversion: 2.1 time: 0.125916 Jun 21 19:06:26.949827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 181/367] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:26 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1088 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:27.411206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:27.412131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:27.423544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:27.424517 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:27.427558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:27.428070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:27.505457 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:27.509672 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:27.510330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lazy-loading 'fault' on Instance uuid 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:06:27.576685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:27.585483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-279f4dff-8edd-4d21-b764-026526e6d3ae tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 200 len: 1303 microversion: 2.1 time: 0.180802 Jun 21 19:06:27.586724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 187/368] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:27 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:27.979755 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:27.981015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:27.990750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:27.991471 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:27.992543 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:27.993239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:28.111063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:28.119273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5612bd87-73d6-4b8d-bf3b-a0deab638ad9 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1194 microversion: 2.1 time: 0.145591 Jun 21 19:06:28.119912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 182/369] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:27 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:28.616549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:28.618354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:28.629292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:28.630246 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:28.631223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:28.631914 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:28.657874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] HTTP exception thrown: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Request method failure captured: Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e HTTP/1.1 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishacYCn2t03TzDnO32i4JCDMDEToVnYDIAryrev3UUypXTM9wxEpGoAFsCqQaVVCP4PmrEi2BlaaSoXkWncOSUJpVafoZO9lT3QLr6joItDEXta_O1UWiR3PXbcsRDBJa8nYfWxOD1QfMWvMQs99vNRRcRe0wZxgw997CtABsVy4F0I Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 3ede6086ad76404a8ad65f0525ac4a53 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:06:28.662107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3ede6086ad76404a8ad65f0525ac4a53"}]}] Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 3ede6086ad76404a8ad65f0525ac4a53 Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesActionsTest-1508109948-project Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 6af4701349d44699a8f04e1c8313de9e Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesActionsTest-1508109948-project Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. Jun 21 19:06:28.664465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e'} Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:06:28.666291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. Jun 21 19:06:28.668622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:06:28.670259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Returning 404 to user: Instance 3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:06:28.670259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df8ad2df-f3b2-4ff9-8bfd-c2c6b0db022a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e" status: 404 len: 111 microversion: 2.1 time: 0.052631 Jun 21 19:06:28.670259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 188/370] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:28 2022] GET /compute/v2.1/servers/3fd72a1f-50fd-4011-b7d6-1dfaa16e6d2e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:06:28.720578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1767243090", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "networks": [{"uuid": "efffd005-1431-44f7-ab80-b744d0526f8f"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:28.803534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] validate_networks() for [('efffd005-1431-44f7-ab80-b744d0526f8f', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:06:29.142683 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:29.143838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:29.156810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:29.157944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:29.159536 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:29.162159 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:29.634980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:29.647263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ca8c94a7-c776-48d1-965e-2c8d2f7e0a35 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.513146 Jun 21 19:06:29.648227 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 189/371] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:29 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:29.695050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:06:29.695594 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:06:29.696329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:06:29.696772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:06:29.697302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:06:29.699484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:29.711828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:29.712405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:29.713369 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:29.713811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:29.723266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:29.740297 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Getting quotas for project 3ede6086ad76404a8ad65f0525ac4a53. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:06:29.748423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Getting quotas for user 6af4701349d44699a8f04e1c8313de9e and project 3ede6086ad76404a8ad65f0525ac4a53. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:06:29.763889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:06:29.766959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:06:29.824747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6f499d88-81c2-4a79-bf29-0163dd231d69 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110893 Jun 21 19:06:29.831379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 183/372] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:06:29.841837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ce1db41-fc1a-431b-872f-4001bdefd808 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:29.843697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ce1db41-fc1a-431b-872f-4001bdefd808 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:29.968643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ce1db41-fc1a-431b-872f-4001bdefd808 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:29.986981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ce1db41-fc1a-431b-872f-4001bdefd808 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1214 microversion: 2.1 time: 0.152042 Jun 21 19:06:29.987798 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 190/373] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:29 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:30.262492 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-a2c53f56-cc7f-4438-9e00-048bbe343a4f req-b6ca6237-b61e-4073-86e9-2f39bcb7b5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:30.305192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a2c53f56-cc7f-4438-9e00-048bbe343a4f req-b6ca6237-b61e-4073-86e9-2f39bcb7b5f0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:30.306312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-a2c53f56-cc7f-4438-9e00-048bbe343a4f req-b6ca6237-b61e-4073-86e9-2f39bcb7b5f0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:30.346242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-a2c53f56-cc7f-4438-9e00-048bbe343a4f req-b6ca6237-b61e-4073-86e9-2f39bcb7b5f0 service nova] Creating event network-changed:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:06:30.351976 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-a2c53f56-cc7f-4438-9e00-048bbe343a4f req-b6ca6237-b61e-4073-86e9-2f39bcb7b5f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101147 Jun 21 19:06:30.357667 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 184/374] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:30.669138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:30.670558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:30.678128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:30.678497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:30.679284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:30.679726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:30.924258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:30.932272 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-31b6d8e9-854c-4edc-9b4e-1305aaa8fd5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.266924 Jun 21 19:06:30.932861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 191/375] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:30 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:31.010179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:31.011774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:31.022858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:31.024571 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:31.027030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:31.028166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:31.164936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:31.174720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-93b677fe-9f32-46dd-bd86-5f190d326250 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1266 microversion: 2.1 time: 0.173505 Jun 21 19:06:31.185468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 185/376] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:30 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:31.950052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:31.950668 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:31.958009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:31.958750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:31.960158 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:31.960939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:32.110019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:32.118684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2df2fabc-ec69-4270-8e3c-5cc7b2eef5a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.172286 Jun 21 19:06:32.119267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 192/377] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:31 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:32.196079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:32.196919 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:32.205870 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:32.206488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:32.207394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:32.207863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:32.281740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:32.292835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-60c1bdcc-b4fb-4109-b987-cfb74c292f5a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1272 microversion: 2.1 time: 0.103052 Jun 21 19:06:32.293447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 186/378] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:32 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:33.135964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:33.137585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:33.151948 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:33.153553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:33.159814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:33.161563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:33.322849 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:33.323955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:33.341530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:33.342412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:33.343553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:33.344385 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:33.504264 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:33.522207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-624ade1a-991b-469a-9636-30a7e712e381 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1272 microversion: 2.1 time: 0.212403 Jun 21 19:06:33.522890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 187/379] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:33 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:33.936613 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:33.948567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5d413a8-5600-42ef-9188-a69fabe1a814 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.816324 Jun 21 19:06:33.959429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 193/380] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:33 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:34.547039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:34.547589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:34.554009 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:34.554454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:34.555227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:34.555661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:34.776350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:34.784698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ad6f90b6-2751-4f2a-b025-59fe15b58301 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.241858 Jun 21 19:06:34.785318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 188/381] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:34 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:34.970376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:34.970376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:34.982007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:34.982465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:34.983298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:34.983736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:35.202375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e9907e1a-3f37-491c-9adf-5b1a21eec749 req-13ba71ff-b956-43cc-a700-2a1e5bc3b29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb946f0-2baf-4757-92b3-8b544e28fb7b", "tag": "af5b277d-fd73-4b94-ac8a-735f614c40c8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:35.215242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e9907e1a-3f37-491c-9adf-5b1a21eec749 req-13ba71ff-b956-43cc-a700-2a1e5bc3b29e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:35.216016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e9907e1a-3f37-491c-9adf-5b1a21eec749 req-13ba71ff-b956-43cc-a700-2a1e5bc3b29e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:35.228611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e9907e1a-3f37-491c-9adf-5b1a21eec749 req-13ba71ff-b956-43cc-a700-2a1e5bc3b29e service nova] Creating event network-changed:af5b277d-fd73-4b94-ac8a-735f614c40c8 for instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b on hv-cinder-84630 Jun 21 19:06:35.234488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:35.236263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e9907e1a-3f37-491c-9adf-5b1a21eec749 req-13ba71ff-b956-43cc-a700-2a1e5bc3b29e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Jun 21 19:06:35.237454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 189/382] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:06:35.246781 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-deebf70a-afad-489a-bb50-ad6b0b6e6d0c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.282786 Jun 21 19:06:35.247705 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 194/383] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:34 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:35.375220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-42677000", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "networks": [{"uuid": "bf695ccb-a2a7-418b-a5d5-7bfb8f8a4bdd"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:35.439107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] validate_networks() for [('bf695ccb-a2a7-418b-a5d5-7bfb8f8a4bdd', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:06:35.803797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:35.804570 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:35.812509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:35.813287 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:35.814313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:35.814839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:36.070969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:36.081342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9d2dc38d-9229-4ff7-b7d3-c1e47cfca34e tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.282248 Jun 21 19:06:36.081954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 195/384] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:35 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:36.088050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:06:36.088580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:06:36.088984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:06:36.089424 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:06:36.089996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:06:36.100768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:36.101255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:36.102065 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:36.102504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:36.120027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Getting quotas for project f9f8ecb9ed854cf28de16f950daf39e5. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:06:36.124306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Getting quotas for user 60db31dcc6944f63b078d2893640e0b8 and project f9f8ecb9ed854cf28de16f950daf39e5. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:06:36.135990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:06:36.138362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:06:36.185804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b99d0f29-8dd0-4bd6-9c06-220fc6395a4b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815691 Jun 21 19:06:36.187076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 190/385] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:06:36.198592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b7644b7-ae62-414a-958f-e692e82744b1 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:36.199118 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b7644b7-ae62-414a-958f-e692e82744b1 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:36.260453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b7644b7-ae62-414a-958f-e692e82744b1 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:36.270241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b7644b7-ae62-414a-958f-e692e82744b1 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1217 microversion: 2.1 time: 0.075145 Jun 21 19:06:36.271715 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 196/386] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:36 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:36.281038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:36.282375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:36.291817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:36.292382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:36.293393 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:36.293977 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:36.460405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:36.469359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-97e6df70-08ee-4ee8-9000-5e352243f2c6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.196272 Jun 21 19:06:36.473128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 191/387] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:36 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:37.098592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:37.099214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:37.101323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:37.110093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.110541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.111321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.111760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.254615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:37.262310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9a7b55d3-1099-40b3-8eb7-9425c1464882 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.167522 Jun 21 19:06:37.262989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 197/388] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:37 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:37.292733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:37.293435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:37.301132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.301673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.302702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.303139 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.371849 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:37.385426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-621a2092-e836-4d9a-8055-797154970738 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1221 microversion: 2.1 time: 0.096865 Jun 21 19:06:37.386440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 192/389] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:37 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:37.487772 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:37.488539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:37.495697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.496149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.496969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:37.497573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:37.646818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:37.658349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-269a6172-defb-4dc1-89d7-e1bbcd143164 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.175242 Jun 21 19:06:37.659021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 198/390] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:37 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:38.280866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:38.281520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:38.287726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.288225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.289072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.289536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.404043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:38.404676 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:38.413233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.414420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.414639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.415254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.432641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:38.441912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-036b4bbd-1123-4f70-bd6e-fe75c67b4490 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.165450 Jun 21 19:06:38.442595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 193/391] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:38 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:38.493735 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:38.501846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-96fec6f3-e03b-4da6-894a-4fbc78c63703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1221 microversion: 2.1 time: 0.102321 Jun 21 19:06:38.502432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 199/392] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:38 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:38.677150 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:38.677678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:38.684058 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.684510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.685427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:38.685866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:38.830869 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:38.839234 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4774fac0-dfed-4a15-ab78-7c85ebffff8e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.165995 Jun 21 19:06:38.839807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 194/393] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:38 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:39.460882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:39.461592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:39.469354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.469811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:39.470590 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.471027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:39.487648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:39.520016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:39.520711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:39.527662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.528133 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:39.528984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.529505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:39.611022 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:39.621367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a7022aa9-710b-45e0-a5cd-4981b8fe3f0b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1213 microversion: 2.1 time: 0.105617 Jun 21 19:06:39.622227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 195/394] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:39 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:39.649113 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:39.657786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e93b426c-627d-444e-8207-ecaf745b531f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.200714 Jun 21 19:06:39.658363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 200/395] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:39 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:39.856008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:39.856553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:39.862953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.863350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:39.864117 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:39.864553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:40.008371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:40.018821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bdbfe7a4-1fca-4448-a39f-9175ddf4afe6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.166321 Jun 21 19:06:40.019870 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 196/396] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:39 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:40.643843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:40.644485 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:40.652167 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:40.652704 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:40.653756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:40.654307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:40.680346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:40.682264 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:40.697728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:40.699287 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:40.700761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:40.701612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:40.773432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:40.783131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-308f2449-8009-485b-9b36-4c9ce60355fa tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1213 microversion: 2.1 time: 0.143203 Jun 21 19:06:40.784862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 201/397] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:40 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1213 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:40.886453 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:40.894646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e9ac645a-741d-49ca-a2ee-ebc75c46dca2 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.223723 Jun 21 19:06:40.895217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 197/398] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:40 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:41.042075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:41.042946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:41.049580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.050430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:41.051395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.052025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:41.399351 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:41.409220 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4ac8eca5-75d8-4073-bc01-8eb63ca229a0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.370844 Jun 21 19:06:41.409873 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 202/399] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:41 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:41.806822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:41.807613 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:41.814480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.815763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:41.817298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.817980 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:41.906251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:41.914419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:41.915931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:41.916542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6243b6f-b234-44fa-a96b-99c4b8adc952 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1275 microversion: 2.1 time: 0.114663 Jun 21 19:06:41.917613 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 198/400] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:41 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:41.924155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.924777 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:41.926002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:41.926604 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:42.152189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:42.160974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a3ddbf00-df11-4935-8e0a-441bcfb455fb tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.251035 Jun 21 19:06:42.161589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 203/401] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:41 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:42.429149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:42.429915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:42.438774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:42.439360 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:42.440718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:42.441294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:42.815981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:42.824106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c80b6766-0a00-4d6f-b8da-6cd1ac765a07 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.400117 Jun 21 19:06:42.824693 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 199/402] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:42 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:42.935190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:42.935907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:42.946922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:42.947710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:42.949118 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:42.949893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.184039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:43.184941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:43.193410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.193857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.194925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.195608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.202485 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:43.216812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a9993fe5-5045-49cf-a149-6728cb9a0e0d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.285756 Jun 21 19:06:43.219352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 204/403] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:42 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:43.460959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:43.469261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-19069d3f-e1de-44a6-ab31-52bdab7182f3 req-4d611a22-bdfb-41a3-b295-20e83bb04171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb946f0-2baf-4757-92b3-8b544e28fb7b", "name": "network-vif-plugged", "status": "completed", "tag": "af5b277d-fd73-4b94-ac8a-735f614c40c8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:43.473792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9c196c39-a95d-4376-97b5-a74d75ca8396 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.298951 Jun 21 19:06:43.475030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 200/404] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:43 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:43.479718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-19069d3f-e1de-44a6-ab31-52bdab7182f3 req-4d611a22-bdfb-41a3-b295-20e83bb04171 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.480396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-19069d3f-e1de-44a6-ab31-52bdab7182f3 req-4d611a22-bdfb-41a3-b295-20e83bb04171 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.501008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-19069d3f-e1de-44a6-ab31-52bdab7182f3 req-4d611a22-bdfb-41a3-b295-20e83bb04171 service nova] Creating event network-vif-plugged:af5b277d-fd73-4b94-ac8a-735f614c40c8 for instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b on hv-cinder-84630 Jun 21 19:06:43.508882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-19069d3f-e1de-44a6-ab31-52bdab7182f3 req-4d611a22-bdfb-41a3-b295-20e83bb04171 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043924 Jun 21 19:06:43.509602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 205/405] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:43.677565 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d212b822-51ac-43f9-bd63-0c017ac63473 req-60d3d27c-7c77-4fbf-afbe-e603d306cfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1151a9-718f-48b6-a22b-0166107d31c0", "tag": "ab6bea59-df05-4f4f-94b7-94cab4030dd8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:43.688689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d212b822-51ac-43f9-bd63-0c017ac63473 req-60d3d27c-7c77-4fbf-afbe-e603d306cfc8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.689163 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d212b822-51ac-43f9-bd63-0c017ac63473 req-60d3d27c-7c77-4fbf-afbe-e603d306cfc8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.702985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d212b822-51ac-43f9-bd63-0c017ac63473 req-60d3d27c-7c77-4fbf-afbe-e603d306cfc8 service nova] Creating event network-changed:ab6bea59-df05-4f4f-94b7-94cab4030dd8 for instance fe1151a9-718f-48b6-a22b-0166107d31c0 on hv-cinder-84630 Jun 21 19:06:43.708182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-d212b822-51ac-43f9-bd63-0c017ac63473 req-60d3d27c-7c77-4fbf-afbe-e603d306cfc8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034676 Jun 21 19:06:43.708784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 201/406] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:06:43.843061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:43.844593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:43.855447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.856210 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:43.857679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:43.858589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:44.030757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:44.040082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-422164c4-a6d8-4d45-90c2-b5b18e19969f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.201805 Jun 21 19:06:44.040832 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 206/407] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:43 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:44.241526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:44.242876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:44.255969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:44.258684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:44.260307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:44.261488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:44.492878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:44.493407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:44.499797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:44.501837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:44.502607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:44.503980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:44.504758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:44.507926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7d3035e1-33d9-48f6-a4d5-192f6a67f1a7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.272993 Jun 21 19:06:44.508472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 202/408] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:44 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:44.651851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:44.663707 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df94552c-c918-474e-8f5c-0ccb1aee075a tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.174847 Jun 21 19:06:44.664402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 207/409] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:44 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:45.062120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:45.062737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:45.069235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.069690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.070462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.070909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.073765 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:45.324209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:45.336931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fdce6759-9ff3-413b-ad23-ff4094c32053 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.278698 Jun 21 19:06:45.338384 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 203/410] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:45 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:45.524947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:45.525598 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:45.532245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.532695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.533535 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.533977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.671482 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:45.679843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c0db8f61-c17e-4f74-b433-85dce571a464 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.158761 Jun 21 19:06:45.680426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 208/411] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:45 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:45.681629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:45.682244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:45.689306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.689741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.690775 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:45.691203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:45.856493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:45.865356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-025094df-f91a-43e1-ae14-8795d1e25ed6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.187244 Jun 21 19:06:45.865875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 204/412] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:45 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:46.097528 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-eb64c802-91cd-4db2-9166-405774984fd7 req-1413f86b-9b31-4cb8-8a11-c1765d123c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "name": "network-vif-plugged", "status": "completed", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:46.108863 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-eb64c802-91cd-4db2-9166-405774984fd7 req-1413f86b-9b31-4cb8-8a11-c1765d123c6b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.109409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-eb64c802-91cd-4db2-9166-405774984fd7 req-1413f86b-9b31-4cb8-8a11-c1765d123c6b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.123141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-eb64c802-91cd-4db2-9166-405774984fd7 req-1413f86b-9b31-4cb8-8a11-c1765d123c6b service nova] Creating event network-vif-plugged:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:06:46.129541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-eb64c802-91cd-4db2-9166-405774984fd7 req-1413f86b-9b31-4cb8-8a11-c1765d123c6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037213 Jun 21 19:06:46.130252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 209/413] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:46.358796 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:46.359688 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=14 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:46.364077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:46.364686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:46.371737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.372158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.372932 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.373397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.518043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:46.527547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bab75a43-26a7-4d8f-bfee-01b3a5a8a09c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.169400 Jun 21 19:06:46.528130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 205/414] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:46 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:46.695663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=10 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:46.700688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:46.702077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:46.709388 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.709841 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.710623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.711061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.852424 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:46.860340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b3208c74-c6b3-4db8-aad6-b923857db74f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.165523 Jun 21 19:06:46.860925 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 210/415] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:46 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:46.884081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:46.884698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:46.891630 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.892004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:46.892780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:46.893255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:47.029884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:47.037929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-095cd65b-1b97-4edc-9e64-6250a34974df tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.157879 Jun 21 19:06:47.038534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 206/416] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:46 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:47.544799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:47.546076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:47.552083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:47.552525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:47.553310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:47.553736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:47.685913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:47.693764 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-13ac37eb-37db-481f-8be8-513f75e97f6a tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.152838 Jun 21 19:06:47.694327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 211/417] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:47 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:47.876458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:47.877075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:47.883218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:47.883607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:47.884370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:47.884807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:48.017436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:48.025078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9eda2161-24fa-4cb9-adf5-d97c9ce25253 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.152580 Jun 21 19:06:48.025673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 207/418] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:47 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:48.054760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:48.055634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:48.061864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:48.062321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:48.063086 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:48.063527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:48.194478 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:48.202909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b543093-e479-4c10-8bd5-0c8cb0be7f2c tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1314 microversion: 2.1 time: 0.152090 Jun 21 19:06:48.203674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 212/419] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:48 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:48.710032 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:48.710640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:48.716802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:48.717382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:48.718137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:48.718564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:48.852465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:48.860527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dfe531ea-6298-48b2-a290-d303a452fc5d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.154310 Jun 21 19:06:48.861119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 208/420] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:48 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:49.042759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:49.043378 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:49.050121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.050573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.051339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.051776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.220677 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:49.221398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:49.229456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.230485 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.230607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:49.232219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.233778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.240812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef960ed8-f5f2-480d-9c41-238cbf635459 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.201945 Jun 21 19:06:49.250938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 213/421] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:49 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:49.382195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:49.393336 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6d02ee35-a34e-4501-9f13-af3fa1dd559f tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1498 microversion: 2.1 time: 0.176834 Jun 21 19:06:49.393966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 209/422] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:49 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:49.877520 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:49.878425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:49.884491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.884959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.885760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.886297 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.906365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:49.907117 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:49.914672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.915159 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.916068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:49.916519 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:49.948178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:06:50.036823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14f77783-fb1f-4e76-8086-4a2057429d63 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 204 len: 0 microversion: 2.1 time: 0.133795 Jun 21 19:06:50.040800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 210/423] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:06:49 2022] DELETE /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:06:50.048730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:50.048730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:50.056759 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.057422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.058674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.058882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.316724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:50.327964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9ccbadf6-ecaf-4d99-bec0-28d74b551740 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.451657 Jun 21 19:06:50.327964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 214/424] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:49 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:50.330582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:50.331204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:50.337980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.338997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.339901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.340345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.348665 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:50.356148 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-946a32d8-b22e-41c2-bc28-3670e5ecbfb6 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1504 microversion: 2.1 time: 0.313924 Jun 21 19:06:50.356716 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 211/425] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:50 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:50.459171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:50.459805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:50.465737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.466201 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.467481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.467912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.475078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:50.483135 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-776bf85b-eeb7-4fca-a38d-5fee6e8a614d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.155797 Jun 21 19:06:50.483715 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 215/426] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:50 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:50.492456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b18da3e8-6055-4d7c-b515-b84fab1af25b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/ips" status: 200 len: 151 microversion: 2.20 time: 0.037087 Jun 21 19:06:50.493022 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 212/427] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jun 21 19:06:50 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 19:06:50.836070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:50.836921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:50.843841 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.844302 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.845120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:50.845550 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:50.868612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bae16ed8-5853-464e-8333-a7707e6938bf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/ips" status: 200 len: 146 microversion: 2.1 time: 0.036345 Jun 21 19:06:50.869127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 216/428] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:06:50 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:51.342447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:51.343057 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:51.349053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.349622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.350271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.350703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.374334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:51.374948 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:51.381522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.382024 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.382748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.383185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.556174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:51.563826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:51.564576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-421bec66-a99d-4f3d-9380-9e639dceb7d4 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.225915 Jun 21 19:06:51.565500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 213/429] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:51 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:51.571029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:51.571654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:51.572369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f69481dd-d688-463c-9d59-0ff7fcd28209 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1504 microversion: 2.1 time: 0.202394 Jun 21 19:06:51.574400 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 217/430] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:51 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:51.578166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.578620 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.579392 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:51.579828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:51.983460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:51.991613 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6fe3fa03-86ac-4156-9adf-31bf9fc817ee tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.424911 Jun 21 19:06:51.992190 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 214/431] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:51 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:52.523793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-8156452d-5eca-4929-b190-e5e2afc6b2cb req-908e7653-8925-4ed6-b99d-70cafcc5a595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1151a9-718f-48b6-a22b-0166107d31c0", "name": "network-vif-plugged", "status": "completed", "tag": "ab6bea59-df05-4f4f-94b7-94cab4030dd8"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:52.533407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-8156452d-5eca-4929-b190-e5e2afc6b2cb req-908e7653-8925-4ed6-b99d-70cafcc5a595 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:52.534046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-8156452d-5eca-4929-b190-e5e2afc6b2cb req-908e7653-8925-4ed6-b99d-70cafcc5a595 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:52.546457 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-8156452d-5eca-4929-b190-e5e2afc6b2cb req-908e7653-8925-4ed6-b99d-70cafcc5a595 service nova] Creating event network-vif-plugged:ab6bea59-df05-4f4f-94b7-94cab4030dd8 for instance fe1151a9-718f-48b6-a22b-0166107d31c0 on hv-cinder-84630 Jun 21 19:06:52.551951 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-8156452d-5eca-4929-b190-e5e2afc6b2cb req-908e7653-8925-4ed6-b99d-70cafcc5a595 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 Jun 21 19:06:52.552547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 218/432] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:52.582298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:52.583013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:52.590223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:52.590772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:52.591491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:52.591695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:52.592744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:52.592846 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:52.601573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:52.602033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:52.602721 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:52.603155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:52.618459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:52.798488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:52.801928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:52.808105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7c16f055-225f-474e-8dd7-8c2c7822799b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1260 microversion: 2.1 time: 0.230309 Jun 21 19:06:52.808679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 215/433] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:52 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:52.810945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-08172733-fb01-4719-be10-ddb8f1a77f01 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1504 microversion: 2.1 time: 0.224306 Jun 21 19:06:52.811511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 219/434] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:52 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:53.008129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:53.009051 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:53.016351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.016804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.017610 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.018040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.157435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:53.164885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-105c47cc-78ba-4e2c-bb8b-11b9f9d1ef07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.160989 Jun 21 19:06:53.165476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 216/435] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:53 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:53.474599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:53.475140 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:53.478087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:53.482602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.483051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.484399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.484838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.508879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lazy-loading 'flavor' on Instance uuid 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:06:53.805441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-153fb51f-114d-4476-98a2-83eea17f58ba tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/action" status: 202 len: 0 microversion: 2.20 time: 0.334590 Jun 21 19:06:53.806363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 220/436] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 19:06:53 2022] POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:06:53.816192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:53.816803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:53.820603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:53.825176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.825896 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.827639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.828256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.834455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:53.834455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:53.841558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.842102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.843461 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.843881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.953625 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:53.962547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d946506c-ef8f-4e7d-881a-56579a8edb82 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1462 microversion: 2.1 time: 0.133713 Jun 21 19:06:53.963452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 221/437] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:53 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:53.969658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:53.970817 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:53.978208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.978756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:53.979604 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:53.980218 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.081915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.090322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.091808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.093621 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6927a32a-7c55-4996-84bb-b474a0bda085 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.283290 Jun 21 19:06:54.105130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 217/438] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:53 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:06:54.105130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-4ed4bdd8-aca2-4eea-bb65-adb8306b951d req-5ea02035-5c34-4e32-a0a2-12b0af2727c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb946f0-2baf-4757-92b3-8b544e28fb7b", "name": "network-vif-deleted", "tag": "af5b277d-fd73-4b94-ac8a-735f614c40c8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:54.107314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4ed4bdd8-aca2-4eea-bb65-adb8306b951d req-5ea02035-5c34-4e32-a0a2-12b0af2727c1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.107789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4ed4bdd8-aca2-4eea-bb65-adb8306b951d req-5ea02035-5c34-4e32-a0a2-12b0af2727c1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.120284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-4ed4bdd8-aca2-4eea-bb65-adb8306b951d req-5ea02035-5c34-4e32-a0a2-12b0af2727c1 service nova] Creating event network-vif-deleted:af5b277d-fd73-4b94-ac8a-735f614c40c8 for instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b on hv-cinder-84630 Jun 21 19:06:54.127466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-4ed4bdd8-aca2-4eea-bb65-adb8306b951d req-5ea02035-5c34-4e32-a0a2-12b0af2727c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Jun 21 19:06:54.128597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 218/439] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:54.138150 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6af4568d-1963-4799-82fa-6fc695b9faf2"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:54.140889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:54.151465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.152114 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.153584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.154393 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.154499 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.162920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c8efc362-ff0a-4520-91bb-35b8feb5b147 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1444 microversion: 2.1 time: 0.197934 Jun 21 19:06:54.163099 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:06:54.163489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 222/440] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:53 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1444 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:54.179519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:54.180128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:54.186078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.187067 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.187863 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.188299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.346422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.354114 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5904caf2-4efa-499c-a911-c85ae2de87ca tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1444 microversion: 2.1 time: 0.178526 Jun 21 19:06:54.354688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 223/441] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:54 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:54.359177 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:54.359790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:54.366130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.366502 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.367264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.367699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.547923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:54.555821 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-80caee61-ec2b-4402-a1f1-4011f188f86a tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.200108 Jun 21 19:06:54.556407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 224/442] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:54 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:54.980713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:54.981397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:54.988491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.988953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:54.989793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:54.990272 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.033972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b98fb0f3-bf1c-40d3-8711-da79770c2020 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903328 Jun 21 19:06:55.034537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 219/443] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:06:54 2022] POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:55.043337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:55.043803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.044261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lazy-loading 'fault' on Instance uuid 4eb946f0-2baf-4757-92b3-8b544e28fb7b {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:06:55.113563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:55.114371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:55.120009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af4701349d44699a8f04e1c8313de9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ede6086ad76404a8ad65f0525ac4a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:55.120901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:55.121381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.122159 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:55.122596 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.127549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d127a22e-6e7e-42cd-af57-245120ba6b18 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 200 len: 1304 microversion: 2.1 time: 0.150905 Jun 21 19:06:55.128121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 225/444] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:54 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:55.351563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:55.359688 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:55.361211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:55.362364 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-70e0667b-c95c-4c90-805f-66685b96b248 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.254218 Jun 21 19:06:55.362914 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 220/445] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:55 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:06:55.573627 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:55.574245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:55.581659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:55.582027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.582792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:55.583220 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:55.843989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:55.851856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0a694f7f-7157-4ab7-862e-8ee900adb21e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1317 microversion: 2.1 time: 0.282186 Jun 21 19:06:55.852561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 226/446] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:55 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:06:56.145040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:56.145846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] [instance: 4eb946f0-2baf-4757-92b3-8b544e28fb7b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:56.152710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.153190 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.154023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.154462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.168694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] HTTP exception thrown: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Request method failure captured: Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b HTTP/1.1 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishacYCn2t03TzDnO32i4JCDMDEToVnYDIAryrev3UUypXTM9wxEpGoAFsCqQaVVCP4PmrEi2BlaaSoXkWncOSUJpVafoZO9lT3QLr6joItDEXta_O1UWiR3PXbcsRDBJa8nYfWxOD1QfMWvMQs99vNRRcRe0wZxgw997CtABsVy4F0I Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 3ede6086ad76404a8ad65f0525ac4a53 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:06:56.171142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3ede6086ad76404a8ad65f0525ac4a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3ede6086ad76404a8ad65f0525ac4a53"}]}] Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 3ede6086ad76404a8ad65f0525ac4a53 Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesActionsTest-1508109948 Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesActionsTest-1508109948-project Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 6af4701349d44699a8f04e1c8313de9e Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesActionsTest-1508109948-project Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. Jun 21 19:06:56.172767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '4eb946f0-2baf-4757-92b3-8b544e28fb7b'} Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:06:56.173971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. Jun 21 19:06:56.176210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:06:56.178263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] Returning 404 to user: Instance 4eb946f0-2baf-4757-92b3-8b544e28fb7b could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:06:56.179212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1f84652d-5e48-43b8-bab1-e7cade9eec76 tempest-VolumesActionsTest-1508109948 tempest-VolumesActionsTest-1508109948-project] 10.222.0.70 "GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b" status: 404 len: 111 microversion: 2.1 time: 0.038668 Jun 21 19:06:56.180102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 221/447] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:56 2022] GET /compute/v2.1/servers/4eb946f0-2baf-4757-92b3-8b544e28fb7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:06:56.377827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-01d32dad-ac5f-45ca-9faa-a45ff8e074df req-efeccf5c-405f-4217-9d04-91b68a644818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:06:56.380232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:56.380857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:56.387921 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.388377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.389254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.390551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.405308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01d32dad-ac5f-45ca-9faa-a45ff8e074df req-efeccf5c-405f-4217-9d04-91b68a644818 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.406802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01d32dad-ac5f-45ca-9faa-a45ff8e074df req-efeccf5c-405f-4217-9d04-91b68a644818 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.425350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-01d32dad-ac5f-45ca-9faa-a45ff8e074df req-efeccf5c-405f-4217-9d04-91b68a644818 service nova] Creating event network-changed:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:06:56.433064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-01d32dad-ac5f-45ca-9faa-a45ff8e074df req-efeccf5c-405f-4217-9d04-91b68a644818 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058964 Jun 21 19:06:56.433872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 227/448] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:06:56.566852 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:56.577554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:56.582056 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:56.584708 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fa4c711f-d18f-45c0-b8d4-841b72393346 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.208122 Jun 21 19:06:56.586768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 222/449] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:56 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:06:56.870546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:56.871534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:56.879390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.880354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:56.881440 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:56.882152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:57.352998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:57.360759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f32bb593-d7bc-4a63-b884-6bc1751d3f50 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1506 microversion: 2.1 time: 0.495379 Jun 21 19:06:57.361371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 228/450] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:06:56 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:06:57.606077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:57.606682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:57.618738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:57.619179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:57.619944 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:57.620706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:57.760490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:57.768944 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:57.770488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:57.771656 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-270c09cb-c052-4c13-8761-672c31d07340 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.171518 Jun 21 19:06:57.772194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 223/451] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:57 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:06:58.789843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:58.790451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:58.797062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:58.797546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:58.798316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:58.798752 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:58.928686 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:58.937178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:58.938676 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:06:58.939820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f077796-08c5-42b7-9244-ce9f599b547c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.153931 Jun 21 19:06:58.940633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 229/452] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:58 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:06:59.959140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:06:59.959742 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:06:59.966581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:59.967028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:06:59.968365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:06:59.968799 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:00.102632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:00.110730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:00.112244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:00.113433 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a8fa4d00-924d-4cbf-ac3b-2fec8dcc5533 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.158126 Jun 21 19:07:00.113977 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 224/453] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:06:59 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:01.132045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:01.132973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:01.141078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:01.141562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:01.142350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:01.142822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:01.275560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:01.283376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:01.284868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:01.286042 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-43da6bde-0ac2-46f5-9f3b-a996bc140dbe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.158088 Jun 21 19:07:01.286593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 230/454] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:01 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:02.304811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:02.305388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:02.312605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:02.313059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:02.313911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:02.314364 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:02.459168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:02.472381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:02.474798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:02.476803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-65e58a9a-0b17-4b1a-b305-ee3470d11b0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.175828 Jun 21 19:07:02.477770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 225/455] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:02 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:03.503299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:03.504072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:03.516216 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:03.517077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:03.518282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:03.518799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:03.661937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-641b48e4-d7c8-4936-823d-2fbb289b0cc7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:03.669715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-641b48e4-d7c8-4936-823d-2fbb289b0cc7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:03.670510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-641b48e4-d7c8-4936-823d-2fbb289b0cc7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:03.714964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:03.726173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:03.728617 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:03.730218 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fc3da221-b8c6-4595-81d9-aae7d391ff2c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.232400 Jun 21 19:07:03.731234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 231/456] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:03 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:03.737271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-641b48e4-d7c8-4936-823d-2fbb289b0cc7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Going to try to stop instance {{(pid=117618) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 19:07:03.790425 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-641b48e4-d7c8-4936-823d-2fbb289b0cc7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action" status: 202 len: 0 microversion: 2.1 time: 0.132144 Jun 21 19:07:03.791394 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 226/457] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:07:03 2022] POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:07:03.800335 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:03.801358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:03.813120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:03.813537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:03.814340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:03.814831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:03.965989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:03.974106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-89215ab4-bf4a-4d23-82b7-56bc312c3de6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.178740 Jun 21 19:07:03.974669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 232/458] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:03 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:04.760406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:04.761793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:04.768708 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:04.769431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:04.770208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:04.770653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:04.937733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:04.949113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:04.950702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:04.952223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-78df5f3c-22b5-4f32-b7f5-33960f9f2e10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.206211 Jun 21 19:07:04.964437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 227/459] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:04 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:04.992208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:04.992839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:05.000572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:05.001056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:05.001876 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:05.002305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:05.177232 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:05.195996 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-984f785c-3196-4a69-93d6-2814436db846 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.207841 Jun 21 19:07:05.197179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 233/460] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:04 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:05.977868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:05.978814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:05.985441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:05.986202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:05.987227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:05.987821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:06.156505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:06.167499 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:06.169647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:06.172063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2cdddba0-ac2d-4ed0-8c86-c87ba286be98 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.203119 Jun 21 19:07:06.172636 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 228/461] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:05 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:06.219934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:06.221317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:06.229383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:06.229383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:06.230194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:06.230599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:06.252720 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:06.407769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:06.424042 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6d4d8a10-1635-4983-bd49-2a5275793a2b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.209543 Jun 21 19:07:06.424719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 234/462] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:06 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:07:07.191432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:07.192172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:07.204110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:07.204897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:07.205754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:07.206203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:07.397740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:07.409911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:07.412773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:07.414801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-74fe5b41-e23e-42e6-a69a-114aff347a9f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.227365 Jun 21 19:07:07.415763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 229/463] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:07 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:07.445935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:07.446963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:07.454309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:07.454947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:07.456033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:07.456708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:07.670053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:07.683159 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2b6d1812-19ee-4a70-b0d6-ebfbfd7f8c0c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.241152 Jun 21 19:07:07.683862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 235/464] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:07 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:08.443175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:08.445291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:08.455559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:08.456312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:08.457323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:08.457761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:08.663168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:08.672143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:08.673778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:08.674988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72f6a26a-b8f0-4a0c-a818-ca000f3f499e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.236927 Jun 21 19:07:08.675756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 230/465] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:08 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:08.709649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:08.711701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:08.721037 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:08.721495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:08.722771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:08.723222 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:08.920733 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:08.930362 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-16929075-d42a-4902-8736-3720a42ca8c7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.225656 Jun 21 19:07:08.931966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 236/466] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:08 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:09.703303 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:09.704487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:09.716915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:09.717957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:09.719251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:09.720437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:09.912132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:09.923856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:09.926965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:09.929457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-227c885b-c1b1-4eff-81c2-4bebb5f79cd8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.233526 Jun 21 19:07:09.945680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 231/467] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:09 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:09.961946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:09.963370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:09.976578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:09.977380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:09.978940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:09.979763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:10.236399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:10.248329 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2bf74aaf-26c7-4050-9b5b-675a3a6d27fc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.295824 Jun 21 19:07:10.249205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 237/468] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:09 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:10.953539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:10.954140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:10.961051 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:10.961899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:10.962871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:10.963306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:11.157745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:11.173742 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:11.176911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:11.179038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c541526a-5f84-4a95-a04b-65f097af0ec9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.229832 Jun 21 19:07:11.180097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 232/469] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:10 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:11.274572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:11.275638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:11.286546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:11.287384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:11.288736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:11.289343 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:11.486426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:11.500602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c0243a0d-a1dc-4e56-a609-9e9136d9df59 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.234763 Jun 21 19:07:11.501492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 238/470] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:11 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:12.204542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:12.206426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:12.218472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:12.219030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:12.220884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:12.221970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:12.398904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:12.417760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:12.419518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:12.421289 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-32b25ad2-817e-4c5c-b6e0-cbc8a7e316e9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.224690 Jun 21 19:07:12.433169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 233/471] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:12 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:12.526623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:12.527173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:12.534538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:12.535002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:12.535753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:12.536183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:12.740032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:12.753405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6898dde9-89f9-4d22-af8e-c19dfc76317b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.230392 Jun 21 19:07:12.754046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 239/472] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:12 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:13.454467 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:13.456196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:13.473410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:13.474422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:13.475953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:13.476858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:13.486808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:13.715652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:13.761649 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:13.764932 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:13.767293 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-465e2dd8-4c37-4b53-80fa-451f8dfd5ad2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.321028 Jun 21 19:07:13.785173 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 234/473] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:13 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:13.786058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:13.787110 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:13.796051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:13.796669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:13.797597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:13.798149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:13.991756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:14.008207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-47a3caa9-e5a3-4adc-84db-56bb07de4f27 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.227666 Jun 21 19:07:14.009299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 240/474] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:13 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:14.799174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:14.800489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:14.812667 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:14.813318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:14.814450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:14.815456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:15.033771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:15.034515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:15.041048 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:15.043178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:15.043678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:15.044820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:15.045353 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:15.058940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:15.060608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:15.062808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c76be069-7b40-4b31-a48d-0d4be4ee006f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.270708 Jun 21 19:07:15.077814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 235/475] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:14 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:15.229234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:15.237913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-656c7861-bb96-4c08-8d51-3b4c772e1bce tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.211214 Jun 21 19:07:15.238690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 241/476] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:15 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:16.095861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:16.097001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:16.112113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:16.113543 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:16.115107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:16.116456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:16.262697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:16.265075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:16.284608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:16.285599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:16.286646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:16.288392 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:16.357696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:16.378269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:16.382438 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:16.384450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e4da1277-a5a6-42e2-96ae-a05fbb25002d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.295662 Jun 21 19:07:16.385963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 236/477] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:16 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:16.520932 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:16.535782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2499acba-0d6b-4b51-b35f-4e99ec5e0d30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.283246 Jun 21 19:07:16.536997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 242/478] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:16 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:17.414653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:17.417128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:17.425304 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:17.425895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:17.426797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:17.427288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:17.562492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:17.563727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:17.577397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:17.578202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:17.579595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:17.580366 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:17.645581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:17.660324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:17.663912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:17.667643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-614f508b-6449-49c6-b429-caacea1fe5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.258415 Jun 21 19:07:17.668990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 237/479] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:17 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:17.786237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:17.806451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b56b1f51-b7ee-4224-9ef9-e452818b2704 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.250393 Jun 21 19:07:17.807762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 243/480] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:17 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:18.694578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:18.698192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:18.710028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:18.712018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:18.713905 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:18.714928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:18.836649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:18.848739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:18.863351 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:18.864275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:18.865639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:18.866320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:19.010168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:19.042393 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:19.048149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:19.051305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c1a8c461-79a6-44ac-8156-ba6d4af582a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.362906 Jun 21 19:07:19.066060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 238/481] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:18 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:19.105608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:19.124150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-300ea092-f6ca-44ab-8b18-a0d10fcb0f95 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.301871 Jun 21 19:07:19.126206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 244/482] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:18 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:20.086339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:20.087447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:20.095183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:20.095708 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:20.096567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:20.097132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:20.148436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:20.150939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:20.171040 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:20.171522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:20.174549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:20.175080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:20.476131 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:20.496296 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:20.498286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:20.499860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f39e5da2-ffe6-4e2b-9e75-32b76890fbee tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.417881 Jun 21 19:07:20.500195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 239/483] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:20 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:20.550237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:20.562338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-044bd144-f5cc-4ea5-8eac-a07ddcec066e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.421780 Jun 21 19:07:20.563931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 245/484] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:20 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:07:20.705638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e892c9e0-25e5-4803-814d-7a7a67225568 req-47fb6248-fcff-462c-8e51-53da7cef73e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "name": "network-vif-plugged", "status": "completed", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:20.719177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e892c9e0-25e5-4803-814d-7a7a67225568 req-47fb6248-fcff-462c-8e51-53da7cef73e5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:20.719655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e892c9e0-25e5-4803-814d-7a7a67225568 req-47fb6248-fcff-462c-8e51-53da7cef73e5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:20.734074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e892c9e0-25e5-4803-814d-7a7a67225568 req-47fb6248-fcff-462c-8e51-53da7cef73e5 service nova] Creating event network-vif-plugged:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:07:20.739967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e892c9e0-25e5-4803-814d-7a7a67225568 req-47fb6248-fcff-462c-8e51-53da7cef73e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042690 Jun 21 19:07:20.741119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 240/485] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:07:21.520296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:21.521001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:21.528303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:21.529824 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:21.530860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:21.531522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:21.580806 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:21.582196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:21.589040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:21.589813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:21.590590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:21.591185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:21.795469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:21.810154 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:21.812315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:21.813868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4a0167c9-0d03-4385-adc1-4833442a5e15 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.297842 Jun 21 19:07:21.814553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 246/486] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:21 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:21.840194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:21.851568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1554919a-3176-41be-858b-de5bce371c68 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.275326 Jun 21 19:07:21.861685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 241/487] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:21 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:22.833107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:22.834585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:22.841126 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:22.841810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:22.842763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:22.843364 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:22.869224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:22.870693 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:22.878690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:22.879558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:22.880711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:22.881416 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:23.082013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:23.085414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:23.101682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-876aac88-06ee-4275-acb9-58d3cdd4e6f1 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.236999 Jun 21 19:07:23.114011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:23.114011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:23.114356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 242/488] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:22 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:07:23.114454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-85a04b7e-5830-4625-8e08-ca5a6560ac1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.277948 Jun 21 19:07:23.114454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 247/489] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:22 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:24.124469 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:24.131597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:24.132332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:24.133579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:24.136755 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=52 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:24.147989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=58 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:24.151301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:24.154737 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:24.156593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:24.158113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:24.158595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:24.159585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:24.160232 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:24.165873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:24.382113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:24.391231 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1b026305-2e28-4b4b-8df6-e2e0a6123651 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1722 microversion: 2.1 time: 0.272335 Jun 21 19:07:24.395996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 243/490] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:24 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:24.452558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:24.461959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:24.463766 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:24.465172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3e94717f-74d0-4086-bc8a-95c1cb5b8a25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1742 microversion: 2.20 time: 0.338474 Jun 21 19:07:24.465799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 248/491] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:24 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1742 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:25.414177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:25.414918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:25.423172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.423625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.424568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.424925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.486023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:25.486813 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:25.497980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.499405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.500441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.501149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.745082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:25.754133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:25.755820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:25.757419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-35f7d223-e0cf-4aa6-ac59-9098040a8168 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.277209 Jun 21 19:07:25.761527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:25.780829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 249/492] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:25 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:25.784119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-337553fe-00ad-44ae-84ef-d2e37b51da96 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1699 microversion: 2.1 time: 0.373705 Jun 21 19:07:25.793595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 244/493] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:25 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1699 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:25.803590 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-38a1f61b-00a2-4dc8-bd12-147d4942482d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:25.810141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a1f61b-00a2-4dc8-bd12-147d4942482d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.810599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-38a1f61b-00a2-4dc8-bd12-147d4942482d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.878723 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-38a1f61b-00a2-4dc8-bd12-147d4942482d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Going to try to start instance {{(pid=117619) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 19:07:25.897137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:25.941342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-38a1f61b-00a2-4dc8-bd12-147d4942482d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action" status: 202 len: 0 microversion: 2.1 time: 0.141150 Jun 21 19:07:25.942416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 250/494] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:07:25 2022] POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:07:25.951964 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:25.952782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:25.971568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.972079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:25.972954 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:25.973405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:26.208270 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:26.218629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-21fe7970-98e3-423c-88f0-5657067a6d5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1708 microversion: 2.1 time: 0.271042 Jun 21 19:07:26.220273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 245/495] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:25 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1708 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:26.785216 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:26.786084 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:26.811073 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:26.813963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:26.816610 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:26.817663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:27.092888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:27.102092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:27.103653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:27.104855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-432206f1-4ed3-4d0b-ad6a-c5aa75ae91d1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.324298 Jun 21 19:07:27.105434 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 251/496] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:26 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:27.237659 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:27.238353 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:27.245851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:27.246454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:27.247416 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:27.247942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:27.396446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:27.407517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a6231870-ec3d-45be-b027-147b0c249bab tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1708 microversion: 2.1 time: 0.175404 Jun 21 19:07:27.408232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 246/497] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:27 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1708 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:07:28.126700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:28.127323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:28.134219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:28.134678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:28.135453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:28.135891 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:28.283013 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:28.291979 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:28.293506 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:28.295203 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6e12a7d1-01f9-478b-9f4d-fc370fea0ab5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.172878 Jun 21 19:07:28.296180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 252/498] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:28 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:28.427524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:28.428189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:28.436536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:28.437080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:28.437887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:28.438316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:28.613603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:28.623549 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-96d84457-8394-4e09-819b-148143a38ebb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1712 microversion: 2.1 time: 0.200534 Jun 21 19:07:28.624191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 247/499] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:07:28 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1712 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:07:29.323791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:29.325043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:29.332878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:29.333687 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:29.334636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:29.335066 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:29.502758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:29.511809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:29.513411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:29.514665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d834ca33-dc92-4342-9570-e49864cb13e4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.194720 Jun 21 19:07:29.519041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 253/500] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:29 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:30.532202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:30.532829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:30.540642 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:30.541107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:30.541915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:30.542355 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:30.708564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:30.718187 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:30.720906 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:30.722141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9d594c90-d997-48cc-b3a6-4485945a254f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.194330 Jun 21 19:07:30.722695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 248/501] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:30 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:31.740640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:31.741323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:31.748403 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:31.748855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:31.749663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:31.750099 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:31.910563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:31.919204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:31.921186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:31.922392 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-db0c1166-d033-4a7b-b6a1-9191bf39c261 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.185645 Jun 21 19:07:31.922949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 254/502] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:31 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:32.956949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:32.956949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:32.958837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:32.958837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:32.959204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:32.960134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:33.172199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:33.183949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:33.187169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:33.189131 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e5957316-1190-4a8e-b332-7fd773008717 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.246936 Jun 21 19:07:33.209549 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 249/503] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:32 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:34.216506 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:34.217126 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:34.224171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:34.224617 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:34.225410 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:34.226121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:34.403853 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:34.417822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:34.419405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:34.420621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b0d0ac5-4211-4285-8e55-f298e71aa692 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.208500 Jun 21 19:07:34.421692 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 255/504] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:34 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:35.445178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:35.446260 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:35.457127 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:35.457590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:35.458895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:35.459668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:35.907288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:35.916405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:35.918502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:35.920435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f29da65f-19b5-435b-a62b-dc31e1518385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.482350 Jun 21 19:07:35.921985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 250/505] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:35 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:36.337465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901e2e2c-31bc-4d5e-b61f-df8bb687574e", "device": "/dev/sdb"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:36.341580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:36.349458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:36.350222 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:36.351282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:36.351974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:36.949735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:36.951890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:36.962710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:36.963156 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:36.963988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:36.964417 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:36.984384 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:37.033770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a1a47d83-2af6-4a08-80ed-5cfb8863e703 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "POST /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699538 Jun 21 19:07:37.038995 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 256/506] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:07:36 2022] POST /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:07:37.181081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:37.192507 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:37.194401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:37.195862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-532d52c1-79ea-4888-ba24-3a6b944fd020 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.250036 Jun 21 19:07:37.196605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 251/507] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:36 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:38.217845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:38.220498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:38.229907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:38.230708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:38.231720 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:38.232214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:38.416736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:38.427575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:38.429247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:38.430432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2421ce22-bc96-4861-ad55-11060591eeef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.219214 Jun 21 19:07:38.431171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 257/508] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:38 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:39.449808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:39.451033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:39.458500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:39.458953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:39.459752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:39.460192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:39.616922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:39.626064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:39.627622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:39.628853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-42ae23e3-3210-4bda-80ce-75ffad308d50 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.183209 Jun 21 19:07:39.629473 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 252/509] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:39 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:40.647751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:40.648294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:40.655085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:40.655531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:40.656310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:40.656750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:40.793389 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:40.803254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:40.805763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:40.806943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d689e7e3-5780-42b6-9781-9d5e6224e51c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1737 microversion: 2.20 time: 0.163229 Jun 21 19:07:40.807887 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 258/510] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:40 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:41.827359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:41.827981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:41.834795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:41.835243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:41.836022 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:41.836458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:42.072760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:42.081282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:42.082715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:42.083873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1e8cf875-2ba1-4348-b487-7cb56f139076 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1719 microversion: 2.20 time: 0.261039 Jun 21 19:07:42.084422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 253/511] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:41 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:42.675674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-1e39c4a8-dd69-4e3b-bc6a-ce719b8f9528 req-12538fa8-3480-4b9e-9b10-d4da95b0a800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "name": "network-vif-unplugged", "status": "completed", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:42.685605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-1e39c4a8-dd69-4e3b-bc6a-ce719b8f9528 req-12538fa8-3480-4b9e-9b10-d4da95b0a800 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:42.686051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-1e39c4a8-dd69-4e3b-bc6a-ce719b8f9528 req-12538fa8-3480-4b9e-9b10-d4da95b0a800 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:42.697816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-1e39c4a8-dd69-4e3b-bc6a-ce719b8f9528 req-12538fa8-3480-4b9e-9b10-d4da95b0a800 service nova] Creating event network-vif-unplugged:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:07:42.702834 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-1e39c4a8-dd69-4e3b-bc6a-ce719b8f9528 req-12538fa8-3480-4b9e-9b10-d4da95b0a800 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030798 Jun 21 19:07:42.703420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 259/512] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:07:43.102935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:43.103541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:43.111083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:43.111537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:43.112310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:43.112744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:43.244460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:43.252500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:43.254033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:43.255198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-811892ef-0740-47f6-ba1f-f30d2fd3f2b2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1719 microversion: 2.20 time: 0.156375 Jun 21 19:07:43.255754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 254/513] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:43 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:44.274888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:44.275601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:44.281842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.282291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.283052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.283486 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.416440 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:44.425169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:44.426674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:44.427864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d2c4a3d9-a15a-457f-8392-455ce5a736f5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1722 microversion: 2.20 time: 0.157648 Jun 21 19:07:44.428379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 260/514] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:44 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:44.445699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "276131b4-b683-47a5-a501-8ccb537eb57e"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:44.446798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:44.453634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.454087 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.454857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.455297 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.734224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5993ef5c-3ddc-412c-a452-ef7b08b6f712 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292536 Jun 21 19:07:44.734822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 255/515] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jun 21 19:07:44 2022] POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:07:44.847293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:07:44.847859 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:44.853861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.854311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.855096 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.855534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.953201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6fa5d627-eb30-429e-8b8c-408165465119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/action" status: 202 len: 0 microversion: 2.20 time: 0.109317 Jun 21 19:07:44.957240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 261/516] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 19:07:44 2022] POST /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:07:44.963681 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:44.965034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:44.976034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.976819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:44.977983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:44.978600 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:45.132208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:45.142176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:45.143752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:45.144950 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9cab0c7d-056f-46fc-9756-716cbd84b78b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1808 microversion: 2.20 time: 0.185804 Jun 21 19:07:45.145573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 256/517] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:44 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:46.163402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:46.164063 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:46.170894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:46.171349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:46.172132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:46.172592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:46.314783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:46.323771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:46.325813 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:46.326978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d60d0469-4bce-4375-95b0-748b483837d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1750 microversion: 2.20 time: 0.168095 Jun 21 19:07:46.327536 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 262/518] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:46 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:47.345537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:47.346154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:47.352715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:47.353199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:47.353975 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:47.354416 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:47.483298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:47.491686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:47.493221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:47.494375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0e22a024-93b6-4342-a4ec-35c00c992a79 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1750 microversion: 2.20 time: 0.152833 Jun 21 19:07:47.494931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 257/519] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:47 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:48.513524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:48.514155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:48.520697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:48.521183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:48.521953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:48.522387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:48.659098 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:48.667639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:48.669659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:48.670823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7225ca39-7411-4050-8cea-2750d1ff82b5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1750 microversion: 2.20 time: 0.161885 Jun 21 19:07:48.671381 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 263/520] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:48 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:49.689429 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:49.690283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:49.696850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:49.697332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:49.698080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:49.698606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:49.831484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:49.839948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:49.841455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:49.842598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b8ffaba-af68-4e21-9180-39d382c289d0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1750 microversion: 2.20 time: 0.157040 Jun 21 19:07:49.843146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 258/521] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:49 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:50.860443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:50.861083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:50.867757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:50.868200 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:50.868964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:50.869422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:51.004730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:51.013422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:51.014910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:51.016061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b70fc9a-8865-4ed0-ba4b-6effec17d673 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1750 microversion: 2.20 time: 0.159494 Jun 21 19:07:51.016621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 264/522] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:50 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:52.038546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:52.039271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:52.048010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:52.048521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:52.049328 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:52.050069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:52.275934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:52.285840 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:52.287341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:52.288545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5241259f-a1e8-4d33-8425-99c81027f534 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.256828 Jun 21 19:07:52.289113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 259/523] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:52 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:52.752861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:07:52.753383 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:07:53.307254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:53.307922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:53.315402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:53.315843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:53.316597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:53.317025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:53.319930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:53.465692 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:53.474334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:53.475839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:53.477003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3059606c-08be-4c42-a497-04d9f3e36cc5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.173735 Jun 21 19:07:53.477601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 265/524] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:53 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:54.496563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:54.497208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:54.499182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=34 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:54.506156 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:54.506609 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:54.507390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:54.507831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:54.645326 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:54.654619 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:54.656136 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:54.657350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-325da209-94b3-44ed-b10c-04482b7fa9b9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.164904 Jun 21 19:07:54.657909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 260/525] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:54 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:55.675419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:55.675961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:55.678290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=38 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:07:55.683894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:55.684336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:55.685124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:55.685567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:55.824406 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:55.843246 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:55.844751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:55.845950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3f5c0e99-b5e7-4649-b416-dc848dfbdcc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.174500 Jun 21 19:07:55.846510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 266/526] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:55 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:56.863631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:56.864259 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:56.871934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:56.872383 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:56.873202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:56.873643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:57.036041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:57.046251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:57.048284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:57.049871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3fce02b6-b39d-486b-92ab-2a99bfb90ffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.190123 Jun 21 19:07:57.050751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 261/527] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:56 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:07:58.068234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:58.068830 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:58.075524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:58.075976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:58.076788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:58.077219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:58.211684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:58.220903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:58.222439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:58.223603 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-26b38184-cb82-4e66-bfbe-f6b20bd52fe5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.159650 Jun 21 19:07:58.233753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 267/528] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:58 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:07:59.242355 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:07:59.242981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:07:59.250734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:59.251276 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:59.252371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:07:59.252910 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:07:59.431388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:59.444895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:59.447059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:07:59.448464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f73a4359-27ca-4470-8782-7e897c2acc38 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.210084 Jun 21 19:07:59.449484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 262/529] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:07:59 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:00.468179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:00.468782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:00.475546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:00.475997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:00.476769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:00.477237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:00.610083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:00.619228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:00.621552 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:00.622637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-04d0d6ae-998f-4233-bb60-4ebc8d014f25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.158487 Jun 21 19:08:00.623204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 268/530] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:00 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:01.645715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:01.646351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:01.653275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:01.653736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:01.654509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:01.654950 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:01.813805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:01.823485 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:01.826702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:01.827978 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-706828a1-1ff8-4bf9-8b56-01c6e7cef9a6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.188682 Jun 21 19:08:01.828560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 263/531] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:01 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:02.847228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:02.847843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:02.854686 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:02.855185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:02.855970 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:02.856421 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:02.997830 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:03.006381 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:03.007873 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:03.009059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-73e7e32b-61d5-437a-b75c-a5cab8fef767 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.165802 Jun 21 19:08:03.009646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 269/532] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:02 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:04.029042 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:04.029832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:04.036956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:04.037429 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:04.038210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:04.038645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:04.185463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:04.197358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:04.199526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:04.200955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b773505b-3167-42f9-ab6d-3adcf7218ba9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.177052 Jun 21 19:08:04.201858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 264/533] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:04 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:05.220137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:05.220764 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:05.228145 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:05.228596 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:05.229535 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:05.229939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:05.374178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:05.384582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:05.386115 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:05.387874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7db3010d-e24d-45b3-bf2b-61050db31607 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.171603 Jun 21 19:08:05.388442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 270/534] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:05 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:06.413418 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:06.414063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:06.421674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:06.422122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:06.423033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:06.423484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:06.439729 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:06.561983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:06.571339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:06.572842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:06.574076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d3fa5b9c-9ed9-4c51-96f2-2736ef879c4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.164621 Jun 21 19:08:06.574635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 265/535] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:06 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:07.592533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:07.593054 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:07.599700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:07.600147 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:07.600947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:07.601425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:07.759719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:07.769860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:07.771454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:07.772720 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-60e3fbe3-cc9a-467a-a052-3ec4ea3acffe tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.184796 Jun 21 19:08:07.773306 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 271/536] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:07 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:08.791158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:08.791813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:08.800539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:08.801139 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:08.802037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:08.802609 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:08.960252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:08.969989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:08.971511 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:08.972714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-24b67df5-f189-48df-b9ed-aa0072d049d4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.185598 Jun 21 19:08:08.973323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 266/537] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:08 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:09.994476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:09.995515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:10.007488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:10.008184 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:10.013558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:10.013558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:10.261880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:10.274026 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:10.275528 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:10.277561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-de26edf1-6c55-4535-8828-3cbf235c65e1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.289404 Jun 21 19:08:10.278453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 272/538] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:09 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:11.298672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:11.299372 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:11.306540 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:11.306994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:11.307797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:11.308815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:11.356801 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:11.357796 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:11.365933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:11.366530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:11.367447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:11.367988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:11.478814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:11.492875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:11.495683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:11.497754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-473475ee-5198-488e-bf23-f15697776214 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.202886 Jun 21 19:08:11.499445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 267/539] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:11 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:11.544818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'services' on Instance uuid fe1151a9-718f-48b6-a22b-0166107d31c0 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:08:11.668369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-337d5a07-23e9-4750-9c03-294fa6481735 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0/os-volume_attachments/901e2e2c-31bc-4d5e-b61f-df8bb687574e" status: 202 len: 0 microversion: 2.1 time: 0.316410 Jun 21 19:08:11.668975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 273/540] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:08:11 2022] DELETE /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0/os-volume_attachments/901e2e2c-31bc-4d5e-b61f-df8bb687574e => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:08:12.524183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:12.525151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:12.533248 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:12.533802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:12.534683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:12.535202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:12.671485 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:12.680242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:12.681858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:12.683066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5f178aa3-9a6f-4fa7-8b39-893df26514ce tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.162867 Jun 21 19:08:12.683619 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 268/541] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:12 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:13.705546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:13.706327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:13.713453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:13.713901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:13.715180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:13.715616 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:13.869923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:13.884281 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:13.887356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:13.889612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dc909d83-2f8c-4372-803c-78f778348c73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.189046 Jun 21 19:08:13.890634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 274/542] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:13 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:14.913636 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:14.914524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:14.922933 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:14.923735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:14.924630 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:14.925238 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:15.197354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:15.209180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:15.210800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:15.211981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6a22e119-f717-4a67-b8f9-65ecdec6f380 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.305933 Jun 21 19:08:15.212550 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 269/543] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:14 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:16.026186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:16.026908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:16.034062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.034511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.035318 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.035758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.068136 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:08:16.158169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0dc39c06-a681-497c-a293-8b83c7169179 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 204 len: 0 microversion: 2.1 time: 0.135250 Jun 21 19:08:16.159186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 275/544] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:08:16 2022] DELETE /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:08:16.168203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:16.169038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:16.175733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.176191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.177023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.177510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.231927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:16.232673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:16.240259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.240719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.241621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:16.242070 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:16.403547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:16.413579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ab6ea8f8-e4b7-4c48-9ff4-5b45d6f5b0b6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1512 microversion: 2.1 time: 0.249265 Jun 21 19:08:16.414345 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 270/545] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:16 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:16.439320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:16.449183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:16.450801 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:16.452056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1690d58a-827d-4a92-83f7-77971542b597 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.224930 Jun 21 19:08:16.452637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 276/546] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:16 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:17.438242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:17.438868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:17.446214 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:17.446811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:17.447638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:17.448148 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:17.481380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:17.482130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:17.494395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:17.495207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:17.496681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:17.497501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:17.676437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:17.684186 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5b525e45-8b94-4b82-98e4-768ded252e8d tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1512 microversion: 2.1 time: 0.249817 Jun 21 19:08:17.684750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 271/547] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:17 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:17.700093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:17.708548 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:17.710010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:17.711160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-18d26033-9966-473c-9322-6b096c691b25 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.235589 Jun 21 19:08:17.711704 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 277/548] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:17 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:18.703194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:18.704063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:18.711386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:18.712062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:18.712842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:18.713308 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:18.731106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:18.731717 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:18.738658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:18.739410 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:18.740180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:18.740782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:18.828340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:18.837719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2096e189-af05-4f86-a72e-bd3b2152a8fe tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1470 microversion: 2.1 time: 0.139783 Jun 21 19:08:18.838663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 272/549] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:18 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1470 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:18.858311 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-988d52d7-09c9-4ffe-b28c-dc76df3bf9e3 req-e4449213-e7ea-441c-a937-cc9893bedbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1151a9-718f-48b6-a22b-0166107d31c0", "name": "network-vif-deleted", "tag": "ab6bea59-df05-4f4f-94b7-94cab4030dd8"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:18.870915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-988d52d7-09c9-4ffe-b28c-dc76df3bf9e3 req-e4449213-e7ea-441c-a937-cc9893bedbc4 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:18.871516 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-988d52d7-09c9-4ffe-b28c-dc76df3bf9e3 req-e4449213-e7ea-441c-a937-cc9893bedbc4 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:18.884531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-988d52d7-09c9-4ffe-b28c-dc76df3bf9e3 req-e4449213-e7ea-441c-a937-cc9893bedbc4 service nova] Creating event network-vif-deleted:ab6bea59-df05-4f4f-94b7-94cab4030dd8 for instance fe1151a9-718f-48b6-a22b-0166107d31c0 on hv-cinder-84630 Jun 21 19:08:18.890105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-988d52d7-09c9-4ffe-b28c-dc76df3bf9e3 req-e4449213-e7ea-441c-a937-cc9893bedbc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039481 Jun 21 19:08:18.891073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 273/550] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:18.925981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:18.935563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:18.937637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:18.938840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a6cf270a-58ea-4afa-86c4-94866a2718e8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.212987 Jun 21 19:08:18.939593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 278/551] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:18 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:19.857702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:19.858404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:19.864631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:19.865083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:19.865865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:19.866304 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:19.897607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:19.898057 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:19.898534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid fe1151a9-718f-48b6-a22b-0166107d31c0 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:08:19.942135 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:19.950269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-adb2a788-d248-4f77-995b-0bddc2a5d19e tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1307 microversion: 2.1 time: 0.097398 Jun 21 19:08:19.950842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 274/552] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:19 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:19.957653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:19.958266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:19.964749 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:19.965225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:19.965991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:19.966433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:19.980925 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:20.097332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:20.106284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:20.107833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:20.108930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d0aeeb8b-1024-429b-ae2c-e3831533a1de tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.155170 Jun 21 19:08:20.109530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 279/553] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:19 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:20.967982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:20.968591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:20.975082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:20.975531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:20.976290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:20.976725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:21.006930 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:21.007373 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:21.007816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid fe1151a9-718f-48b6-a22b-0166107d31c0 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:08:21.049221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:21.056711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-56d369a9-6826-4ff8-bddd-98f885096c74 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 200 len: 1307 microversion: 2.1 time: 0.093186 Jun 21 19:08:21.057306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 275/554] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:20 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:21.126678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:21.127310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:21.133957 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:21.134400 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:21.135156 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:21.135588 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:21.277672 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:21.288180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:21.289702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:21.290902 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1a50d9b9-4603-45a5-89a3-b22b838542ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.168092 Jun 21 19:08:21.291455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 280/555] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:21 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:22.075203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:22.075763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: fe1151a9-718f-48b6-a22b-0166107d31c0] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:22.082606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:22.083053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:22.083859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:22.084292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:22.097750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] HTTP exception thrown: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Request method failure captured: Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 HTTP/1.1 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABisha5DEtWuhYuTQsyHf9jwbpnlNkuoBaM9rBfWwaXGjQJSW9T8fr6zd_JCCakF00Vp6HDi6GepveTS--CafLSdaiDCQ5-EI3JHxo0IaBT7sHwUS5b1g_wSJ5HyHsBgmx_rQ7rebGRKwaJEkNb9GbeUqDHj0VsRpx4ZedNESDcH2hHXCQ Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: f9f8ecb9ed854cf28de16f950daf39e5 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:08:22.099427 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9f8ecb9ed854cf28de16f950daf39e5"}]}] Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: f9f8ecb9ed854cf28de16f950daf39e5 Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotTestJSON-1352601315-project Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 60db31dcc6944f63b078d2893640e0b8 Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotTestJSON-1352601315-project Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. Jun 21 19:08:22.101020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'fe1151a9-718f-48b6-a22b-0166107d31c0'} Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:08:22.101982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. Jun 21 19:08:22.103481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:08:22.104960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Returning 404 to user: Instance fe1151a9-718f-48b6-a22b-0166107d31c0 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:08:22.104960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5c5c38f7-7dba-429d-b912-d1755e67fca8 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0" status: 404 len: 111 microversion: 2.1 time: 0.030234 Jun 21 19:08:22.104960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 276/556] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:22 2022] GET /compute/v2.1/servers/fe1151a9-718f-48b6-a22b-0166107d31c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:08:22.310948 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:22.311749 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:22.319316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:22.319856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:22.320731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:22.321401 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:22.467423 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:22.476371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:22.477940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:22.479112 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aff3003e-3b62-4b7e-9cce-e93301a2408c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.173141 Jun 21 19:08:22.480170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 281/557] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:22 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:23.498482 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:23.499100 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:23.505727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:23.506176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:23.506937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:23.507370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:23.639828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:23.648245 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:23.649781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:23.650940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a15c5a99-a336-49f6-8fc9-e01ebddd3a2f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.156878 Jun 21 19:08:23.651555 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 277/558] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:23 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:24.669746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:24.670326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:24.676712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:24.677190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:24.677949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:24.678377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:24.811431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:24.826860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:24.829763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:24.831564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e5caede3-114b-4381-a9ee-1ccf31e3f2c9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.166069 Jun 21 19:08:24.832567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 282/559] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:24 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:25.850732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:25.851354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:25.853399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=40 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:25.858843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:25.859333 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:25.860116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:25.860554 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:25.999423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:26.007918 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:26.009468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:26.011236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7389163e-0f8c-4d19-af76-63d2d4996bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.164082 Jun 21 19:08:26.011797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 278/560] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:25 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:27.030200 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:27.030818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:27.033229 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:27.038576 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:27.039027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:27.039795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:27.040238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:27.411658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:27.420548 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:27.422104 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:27.423289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3452941c-f690-4a0b-818b-d8c5f8188739 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.397661 Jun 21 19:08:27.423852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 283/561] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:27 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:28.442536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:28.443183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:28.450276 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:28.450726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:28.451496 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:28.451937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:28.581582 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:28.590517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:28.592000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:28.593175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bb564ff0-8661-409c-98ac-3a71787e4397 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.154786 Jun 21 19:08:28.593769 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 279/562] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:28 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:29.119735 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-b727b184-fdec-419e-ad8a-7a517292dc9e req-d49160c5-72df-40f6-99bb-953090902842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "name": "network-vif-plugged", "status": "completed", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:29.129811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-b727b184-fdec-419e-ad8a-7a517292dc9e req-d49160c5-72df-40f6-99bb-953090902842 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:29.130263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-b727b184-fdec-419e-ad8a-7a517292dc9e req-d49160c5-72df-40f6-99bb-953090902842 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:29.142311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-b727b184-fdec-419e-ad8a-7a517292dc9e req-d49160c5-72df-40f6-99bb-953090902842 service nova] Creating event network-vif-plugged:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:08:29.149750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-b727b184-fdec-419e-ad8a-7a517292dc9e req-d49160c5-72df-40f6-99bb-953090902842 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Jun 21 19:08:29.150511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 284/563] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:29.284334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecea6540-a7e5-4085-99ca-a0abb83b65a1"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:29.285536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:29.291842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:29.292286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:29.293081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:29.293635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:29.612612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:29.613307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:29.619416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:29.620371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:29.621140 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:29.621571 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:29.755626 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:29.764969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:29.766509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:29.767686 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c3001cc2-de18-4f06-be00-7909ad9b30cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.159419 Jun 21 19:08:29.768275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 285/564] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:29 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:30.785503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:30.786202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:30.792734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:30.793217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:30.794008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:30.794421 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:30.934360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:30.942992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:30.944472 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:30.945659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-879d2b50-d1f9-475f-acf7-7b912ba592eb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.164124 Jun 21 19:08:30.946215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 286/565] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:30 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:31.964514 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:31.965225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:31.971636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:31.972087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:31.972858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:31.973322 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:32.116773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:32.126438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:32.127974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:32.129433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d648ec07-83ef-43a3-bef2-2e7338f72f3d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.168738 Jun 21 19:08:32.130002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 287/566] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:31 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:32.956258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3c41fc18-5125-4163-9ccc-538746b7ea64 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.782329 Jun 21 19:08:32.956877 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 280/567] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:08:29 2022] POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments => generated 194 bytes in 3784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:33.148464 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:33.149104 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:33.156071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:33.156519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:33.157333 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:33.157765 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:33.290560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:33.299175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:33.300699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:33.301916 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f66cb55b-0885-4798-874a-ff2c199e3caf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.157798 Jun 21 19:08:33.302468 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 288/568] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:33 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:34.077994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-99116192", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "networks": [{"uuid": "bf695ccb-a2a7-418b-a5d5-7bfb8f8a4bdd"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:34.133858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] validate_networks() for [('bf695ccb-a2a7-418b-a5d5-7bfb8f8a4bdd', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:08:34.321327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:34.324007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:34.335384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:34.335384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:34.335384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:34.335851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:34.562850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:34.573964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:34.575471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:34.576665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-18d2c04c-1a38-4014-bb95-c6f6f0327d5f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.259421 Jun 21 19:08:34.577533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 289/569] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:34 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:08:34.660186 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:08:34.660602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:08:34.661134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:08:34.661505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:08:34.661911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:08:34.671375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:34.671845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:34.672644 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:34.673079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:34.690697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Getting quotas for project f9f8ecb9ed854cf28de16f950daf39e5. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:08:34.694798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Getting quotas for user 60db31dcc6944f63b078d2893640e0b8 and project f9f8ecb9ed854cf28de16f950daf39e5. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:08:34.706445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:08:34.708828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:08:34.755190 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f4c6472-7642-4c59-a4ed-8ab6b32fe2a2 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682135 Jun 21 19:08:34.755853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 281/570] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:08:34.766909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7538d72-8d37-4ac9-9052-e7880aec25ad tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:34.767526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e7538d72-8d37-4ac9-9052-e7880aec25ad tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:34.820178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e7538d72-8d37-4ac9-9052-e7880aec25ad tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:34.827727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e7538d72-8d37-4ac9-9052-e7880aec25ad tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1217 microversion: 2.1 time: 0.064880 Jun 21 19:08:34.828917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 290/571] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:34 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:35.596581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:35.597404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:35.606290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:35.606821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:35.607672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:35.608185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:35.611298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:35.757402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:35.766781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:35.768291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:35.769534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8ebad665-3178-4c44-81c7-0061dabfe00f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1806 microversion: 2.20 time: 0.178058 Jun 21 19:08:35.770092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 282/572] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:35 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:35.845292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:35.845940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:35.852947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:35.853422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:35.854176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:35.854607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:35.914558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:35.922186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4cfcba7a-9c76-49d0-ae9e-165351a749cd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1269 microversion: 2.1 time: 0.080702 Jun 21 19:08:35.922756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 291/573] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:35 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:36.787820 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:36.789024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:36.795711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:36.796191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:36.796955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:36.797601 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:36.940426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:36.941044 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:36.949992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:36.950433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:36.951393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:36.951826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:37.047250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:37.055850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:37.057911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:37.059115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ec7dc581-4a4c-4a2b-bb4d-86c611897919 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1793 microversion: 2.20 time: 0.275250 Jun 21 19:08:37.059663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 283/574] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:08:36 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1793 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:08:37.239935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:37.251593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-521946f0-db97-48d9-a809-a4db24cc0762 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.315639 Jun 21 19:08:37.252288 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 292/575] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:36 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:37.675642 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-5ba2899c-9f73-44e0-a21f-c37e44b2138a req-25a47446-7788-4ca3-a43b-1648f37f0c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aace36d9-074e-4abc-ab0b-29741c447ef4", "tag": "702fcd04-047d-455c-b85a-0b7394a32144"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:37.684006 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5ba2899c-9f73-44e0-a21f-c37e44b2138a req-25a47446-7788-4ca3-a43b-1648f37f0c6e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:37.684450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-5ba2899c-9f73-44e0-a21f-c37e44b2138a req-25a47446-7788-4ca3-a43b-1648f37f0c6e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:37.697446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-5ba2899c-9f73-44e0-a21f-c37e44b2138a req-25a47446-7788-4ca3-a43b-1648f37f0c6e service nova] Creating event network-changed:702fcd04-047d-455c-b85a-0b7394a32144 for instance aace36d9-074e-4abc-ab0b-29741c447ef4 on hv-cinder-84630 Jun 21 19:08:37.702668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-5ba2899c-9f73-44e0-a21f-c37e44b2138a req-25a47446-7788-4ca3-a43b-1648f37f0c6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096427 Jun 21 19:08:37.703573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 284/576] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:38.269698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:38.270315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:38.277065 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:38.277547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:38.278320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:38.278776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:38.416922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:38.424308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2968d67a-2568-426c-9281-75727526a8dd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.158471 Jun 21 19:08:38.424880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 293/577] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:38 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:39.441721 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:39.442423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:39.449879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:39.450319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:39.451081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:39.451515 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:39.583272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:39.590702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cab25e3a-3c21-499c-8079-66b3446800bf tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.153400 Jun 21 19:08:39.591277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 285/578] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:39 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:40.607666 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:40.608194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:40.614833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:40.615286 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:40.616055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:40.616493 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:40.751266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:40.758789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-58edc1ef-024e-4ee5-baae-71ce93984c44 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.155062 Jun 21 19:08:40.759365 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 294/579] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:40 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:41.776339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:41.776968 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:41.783632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:41.784080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:41.784854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:41.785323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:41.917562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:41.925159 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2499d097-d833-453b-a327-ca7f6c3c5692 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.153196 Jun 21 19:08:41.925728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 286/580] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:41 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:42.942380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:42.943560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:42.950376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:42.950856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:42.951623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:42.952050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:43.114628 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:43.123081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1819e9c9-a4d7-418d-846e-76b258fc7154 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.184743 Jun 21 19:08:43.123659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 295/581] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:42 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:43.662302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:43.663298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:43.669858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:43.670309 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:43.671077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:43.671508 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:43.695129 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'flavor' on Instance uuid e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:08:43.863898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1bf2d22b-a5b4-4190-9e2a-94b351b968f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/action" status: 200 len: 32 microversion: 2.1 time: 0.205463 Jun 21 19:08:43.864503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 287/582] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:08:43 2022] POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:08:43.874387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:43.875015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:43.881133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:43.881623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:43.882432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:43.882884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:44.117609 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:44.126948 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2718b508-d85c-468c-b64e-6827c10189a7 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.256506 Jun 21 19:08:44.127548 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 296/583] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:43 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:44.140851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:44.141689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:44.148967 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:44.149472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:44.150290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:44.150733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:44.345215 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:44.352806 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5c862f0f-99fb-464b-beb2-4fb858eb771b tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.216150 Jun 21 19:08:44.354124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 288/584] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:44 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:45.149834 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:45.151082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:45.153346 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:45.159950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:45.160399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:45.161448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:45.161900 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:45.173662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:45.174467 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:45.239859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-549586a4-4637-488d-82c7-236866d7fc19 req-ca8dd7ab-dcfa-4cba-939a-dd7ab0bfc94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace36d9-074e-4abc-ab0b-29741c447ef4", "name": "network-vif-plugged", "status": "completed", "tag": "702fcd04-047d-455c-b85a-0b7394a32144"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:45.254337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-549586a4-4637-488d-82c7-236866d7fc19 req-ca8dd7ab-dcfa-4cba-939a-dd7ab0bfc94b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:45.254788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-549586a4-4637-488d-82c7-236866d7fc19 req-ca8dd7ab-dcfa-4cba-939a-dd7ab0bfc94b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:45.267163 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-549586a4-4637-488d-82c7-236866d7fc19 req-ca8dd7ab-dcfa-4cba-939a-dd7ab0bfc94b service nova] Creating event network-vif-plugged:702fcd04-047d-455c-b85a-0b7394a32144 for instance aace36d9-074e-4abc-ab0b-29741c447ef4 on hv-cinder-84630 Jun 21 19:08:45.273176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-549586a4-4637-488d-82c7-236866d7fc19 req-ca8dd7ab-dcfa-4cba-939a-dd7ab0bfc94b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104871 Jun 21 19:08:45.273936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 289/585] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:08:45.332175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:45.334644 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=100 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:45.342141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8ecbaf4-42c9-49a8-a383-8ed4def96756 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.197601 Jun 21 19:08:45.343022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 297/586] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:45 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:45.373288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:45.374007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:45.381277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:45.381738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:45.382527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:45.382973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:45.583860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:45.591516 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a73e1712-c076-4fc6-8b0e-6ed1614e989f tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.224070 Jun 21 19:08:45.592083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 290/587] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:45 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:46.360497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:46.361180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:46.368135 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:46.368583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:46.369409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:46.369843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:46.533847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:46.548438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-690252bc-066a-45fc-a8b4-cd2c2eef364f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.191797 Jun 21 19:08:46.549494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 298/588] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:46 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:46.609181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:46.609718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:46.616581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:46.620018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:46.620901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:46.621384 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:46.759039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:46.768877 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5d0996c2-438d-4eff-8a43-6d7a686611c6 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1317 microversion: 2.1 time: 0.163703 Jun 21 19:08:46.769683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 291/589] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:46 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:47.574603 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:47.575220 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:47.581930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.582377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:47.583151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.583590 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:47.751844 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:47.760981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-af0ca5ce-cc97-4c87-88ed-839198995c5f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.190126 Jun 21 19:08:47.761611 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 299/590] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:47 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:47.786454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:47.787081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:47.794273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.794715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:47.795504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.795941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:47.944507 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:47.956579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-82ff7fda-0e1c-47e3-915c-d00465ab3ecc tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1506 microversion: 2.1 time: 0.173698 Jun 21 19:08:47.957672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 292/591] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:47 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:47.980662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "777c1999-5ec1-4faa-990d-d61a32004728", "device": "/dev/sdb"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:47.981898 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:47.988394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.988837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:47.989659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:47.990094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:48.242620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5acb9470-4c0c-4332-8e2d-2abe66f1e552 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "POST /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265822 Jun 21 19:08:48.243364 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 300/592] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:08:47 2022] POST /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:48.777861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:48.778621 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:48.784881 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:48.785478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:48.786211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:48.786646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:49.263153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:49.271274 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f110a229-9dbe-4bbc-8b87-6fef93d9a2cc tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.497285 Jun 21 19:08:49.271873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 293/593] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:48 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:50.292023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:50.292634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:50.299093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:50.299549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:50.300438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:50.300912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:50.446858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:50.456258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-518333e9-c30f-4a77-afb4-dbc7b6bc5ac3 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.169451 Jun 21 19:08:50.456850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 301/594] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:50 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:51.476567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:51.477214 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:51.483903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:51.484352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:51.485142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:51.485581 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:51.627267 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:51.635756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-26b7c7cb-dd7d-4d5a-a7d8-bf491963380d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.164969 Jun 21 19:08:51.636331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 294/595] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:51 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:52.653172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:52.653745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:52.660243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:52.660689 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:52.661553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:52.661988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:52.794463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:52.803518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cb496c34-cb16-408d-96d1-152ac0d5b69e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.154254 Jun 21 19:08:52.804172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 302/596] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:52 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:53.705850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:53.706491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:53.714108 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.714559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.715337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.715774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.741567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:08:53.821870 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:53.822441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:53.825180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f1b71d93-b689-4042-9a76-893badceeed4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "DELETE /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 204 len: 0 microversion: 2.1 time: 0.122974 Jun 21 19:08:53.825788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 295/597] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:08:53 2022] DELETE /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:08:53.833060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.833611 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.834451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.835352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.835917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:53.836774 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:53.843831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.844290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.845074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:53.845545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:53.862527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:54.047011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:54.051410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:54.055523 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bfa19b96-d8fa-49ba-b0fe-91d5f53e3854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.237733 Jun 21 19:08:54.056656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 303/598] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:53 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:54.059773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b4371f77-03b7-4e71-9fff-fa9e56ad99b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1578 microversion: 2.1 time: 0.229130 Jun 21 19:08:54.060348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 296/599] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:53 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1578 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:55.075709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:55.076337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:55.079808 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:55.080803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:55.083301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:55.083790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:55.084558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:55.085000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:55.091066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:55.091822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:55.093160 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:55.093806 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:55.335207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:55.343534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-21562400-f8d9-4d64-81ed-ed29e2aa4e60 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.273480 Jun 21 19:08:55.344131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 304/600] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:55 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:55.346343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:55.355098 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8ed96905-d995-4f28-921a-56ffbdc6bd8e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1578 microversion: 2.1 time: 0.280062 Jun 21 19:08:55.355673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 297/601] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:55 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1578 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:56.361616 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:56.362307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:56.369483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:56.369989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:56.370888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:56.371331 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:56.373145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:56.374017 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:56.376354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:56.381805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:56.382261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:56.383039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:56.383481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:56.575804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:56.584271 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5386121-85e9-460d-9335-25a7d2ed3710 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.226472 Jun 21 19:08:56.584864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 305/602] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:56 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:56.590452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:56.598350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-43e5f488-4d6a-4887-aa48-7a1e8c91b3bb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1578 microversion: 2.1 time: 0.229875 Jun 21 19:08:56.598928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 298/603] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:56 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1578 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:57.603840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:57.604735 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:57.607206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=48 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:08:57.612253 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:57.612701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:57.613495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:57.613924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:57.621405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:57.622618 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:57.629752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:57.630202 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:57.631176 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:57.631782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:57.879671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:57.888728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d3fa1bcd-b447-4b25-874d-0a87dd6247af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.288676 Jun 21 19:08:57.889627 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 306/604] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:57 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:57.921834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:57.935590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8d5727fc-06f5-4e90-98f9-011becf46559 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1578 microversion: 2.1 time: 0.317740 Jun 21 19:08:57.937133 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 299/605] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:57 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1578 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:08:58.364703 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-d24480a3-5b01-42ca-8546-edcc4c47ef02 req-d253e66e-cf6c-47b4-a8f7-a302569b0714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a160e9-aeee-4070-b1e2-b21fe7d01849", "name": "network-vif-deleted", "tag": "5d024db7-613f-4299-973b-fe026f018148"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:08:58.385744 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d24480a3-5b01-42ca-8546-edcc4c47ef02 req-d253e66e-cf6c-47b4-a8f7-a302569b0714 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:58.386633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d24480a3-5b01-42ca-8546-edcc4c47ef02 req-d253e66e-cf6c-47b4-a8f7-a302569b0714 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:58.404293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-d24480a3-5b01-42ca-8546-edcc4c47ef02 req-d253e66e-cf6c-47b4-a8f7-a302569b0714 service nova] Creating event network-vif-deleted:5d024db7-613f-4299-973b-fe026f018148 for instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 on hv-cinder-84630 Jun 21 19:08:58.410771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-d24480a3-5b01-42ca-8546-edcc4c47ef02 req-d253e66e-cf6c-47b4-a8f7-a302569b0714 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058224 Jun 21 19:08:58.412077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 307/606] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:08:58.907169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:58.908456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:58.916983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:58.917711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:58.918880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:58.919594 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:58.959722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:08:58.961820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:08:58.972930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:58.974055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:58.975565 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:08:58.976530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:08:59.140781 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:59.151716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1dc66454-c46f-4a22-9d5c-5712594312af tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1226 microversion: 2.1 time: 0.198940 Jun 21 19:08:59.152759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 308/607] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:58 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:08:59.195463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:08:59.209925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-abe78706-cf45-45d7-b31c-a571eeb65193 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.306873 Jun 21 19:08:59.210825 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 300/608] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:08:58 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:00.177769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:00.178638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:00.186738 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:00.187296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:00.188193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:00.188758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:00.234935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:00.236102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:00.248933 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:00.249730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:00.251126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:00.252218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:00.266452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:00.280466 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5e25dff2-586c-4f77-928f-a8bd999464ee tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1226 microversion: 2.1 time: 0.106313 Jun 21 19:09:00.281906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 309/609] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:00 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:00.409362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:00.419105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-413d1a47-1a5e-4cf6-8899-ad212233d51f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.191870 Jun 21 19:09:00.419887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 301/610] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:00 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:01.297857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:01.298503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:01.305558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:01.306019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:01.306793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:01.307233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:01.405483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:01.414783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d99da273-414b-4edc-babe-6f8ca976bd23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1226 microversion: 2.1 time: 0.120709 Jun 21 19:09:01.415376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 310/611] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:01 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:01.436654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:01.437494 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:01.444474 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:01.444949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:01.445747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:01.446186 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:01.592686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:01.601013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d680bb43-7677-489f-9736-2a808fffc2a1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.168237 Jun 21 19:09:01.601638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 302/612] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:01 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:02.432724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:02.433549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:02.442551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:02.443213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:02.444153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:02.444612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:02.514818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:02.522784 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ca0c4878-9518-4b29-ad2d-a2a6580d2cfc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1226 microversion: 2.1 time: 0.094575 Jun 21 19:09:02.523431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 311/613] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:02 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:02.617684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:02.618880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:02.625816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:02.626266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:02.627055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:02.627493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:02.791019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:02.799290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dffa3744-5a2b-4339-8dcc-9bc1ee095233 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.185454 Jun 21 19:09:02.799885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 303/614] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:02 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:03.539448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:03.540050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:03.546760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:03.547209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:03.548008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:03.548448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:03.615104 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:03.622917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a199fd54-ea79-43df-b0eb-ff5b6c93b440 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1226 microversion: 2.1 time: 0.087311 Jun 21 19:09:03.623579 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 312/615] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:03 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:03.818663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:03.819584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:03.828302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:03.828971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:03.829914 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:03.830507 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:03.978280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:03.986741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7a604fba-97cd-4963-a093-4cb51b367fb1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.172843 Jun 21 19:09:03.987319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 304/616] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:03 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:04.641583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:04.642359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:04.651249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:04.651894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:04.653007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:04.653756 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:04.692087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:04.692547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:04.693005 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 00a160e9-aeee-4070-b1e2-b21fe7d01849 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:04.694961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:04.750170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:04.758900 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-03672a95-cf74-4f0b-b803-c60ba39ed78c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 200 len: 1231 microversion: 2.1 time: 0.122614 Jun 21 19:09:04.759613 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 313/617] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:04 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 1231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:05.006586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:05.007277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:05.015542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:05.016046 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:05.017037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:05.017572 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:05.166736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:05.175034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3e22bc87-c773-4775-ab63-f8520ea55db9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.173008 Jun 21 19:09:05.175608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 305/618] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:05 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:05.783827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:05.784447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:05.792001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:05.792447 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:05.793258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:05.793692 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:05.807837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] HTTP exception thrown: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Request method failure captured: Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 HTTP/1.1 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishZDKkR4HPaezv66AL7gQn-wZWzsR0JZZWPkOxyoZApjGWnCtI-dDujO0xTVMVoYNnXj6w7MPMLFNzXZOdgH5GGqvz3MYHQwIM3ALNuuR9VlbnUcR6qHTOT8DARdAvbQ9Q92-51eQqlRcMxprm3O7LWCbIVNE9D4ljCOawL4r3wSZ7Y Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:09:05.809501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}] Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-528418932 Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 569256e6d1d1418eafb5ff2ed8909926 Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:09:05.811122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '00a160e9-aeee-4070-b1e2-b21fe7d01849'} Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:09:05.812091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:09:05.813477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:05.814906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Returning 404 to user: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:09:05.814906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9f8455b2-4a8c-40ff-b829-8788bc49fba1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 404 len: 111 microversion: 2.1 time: 0.030984 Jun 21 19:09:05.814906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 314/619] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:05 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:09:05.909651 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1208814865", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006781389", "security_groups": [{"name": "tempest-secgroup-smoke-1224501279"}], "block_device_mapping_v2": [{"uuid": "be8fe84a-16cb-46a8-8ba2-f34a807192c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f86cc32-39a0-4e38-9448-e17d5262fa8d"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:06.027350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] validate_networks() for [('2f86cc32-39a0-4e38-9448-e17d5262fa8d', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:09:06.192021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:06.192636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:06.198770 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:06.199217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:06.199992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:06.200422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:06.569712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:06.578284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dc987c63-2152-4029-8f40-70bf61ba3bbb tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.390239 Jun 21 19:09:06.578772 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 315/620] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:06 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:06.650028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:09:06.650314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:09:06.650782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:09:06.651193 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:09:06.651612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:09:06.660612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:06.661054 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:06.661879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:06.662345 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:06.679133 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:09:06.683207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for user 569256e6d1d1418eafb5ff2ed8909926 and project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:09:06.744800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:09:06.746942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be8fe84a-16cb-46a8-8ba2-f34a807192c8',volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:09:06.877735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c201a42d-9bbb-4318-8c5a-4b4af5ab5574 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.971724 Jun 21 19:09:06.878321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 306/621] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:09:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:09:06.889294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bce7cd07-61ff-4cc8-9364-8d1525202c52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:06.889898 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bce7cd07-61ff-4cc8-9364-8d1525202c52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:06.948115 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bce7cd07-61ff-4cc8-9364-8d1525202c52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:06.955065 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bce7cd07-61ff-4cc8-9364-8d1525202c52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1095 microversion: 2.1 time: 0.069786 Jun 21 19:09:06.955792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 316/622] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:06 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:07.599076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:07.599714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:07.607356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:07.607813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:07.608603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:07.609048 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:07.755440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:07.764926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0efb5335-f940-498a-8b0f-f256681e5ab1 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.169797 Jun 21 19:09:07.765675 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 307/623] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:07 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:07.971843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:07.972458 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:07.980481 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:07.980933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:07.981754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:07.982193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:08.046320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:08.054219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eabf56f2-6acb-4278-a051-89dc8739f450 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1145 microversion: 2.1 time: 0.086147 Jun 21 19:09:08.054793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 317/624] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:07 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:08.785880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:08.786500 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:08.793639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:08.794102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:08.794873 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:08.795311 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:09.071615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:09.072277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:09.079171 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:09.079677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:09.080466 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:09.080898 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:09.174977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:09.183649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0dcb8c55-0f48-4b96-9450-a5ac9ab347ff tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1145 microversion: 2.1 time: 0.115975 Jun 21 19:09:09.184928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 318/625] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:09 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:09.222493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:09.231735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-41bc8fb2-5c00-4dc9-b4cc-86db90c64884 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.449708 Jun 21 19:09:09.232607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 308/626] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:08 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:10.202184 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:10.202810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:10.210940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:10.211442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:10.212267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:10.212741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:10.250016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:10.250641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:10.257578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:10.258026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:10.259452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:10.259889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:10.282538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:10.295894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0617261d-f612-46de-980f-8c48efad89f7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1201 microversion: 2.1 time: 0.097169 Jun 21 19:09:10.296963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 319/627] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:10 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:10.410536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:10.419346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-732760c2-39d4-40ae-a505-13ac6d215a8f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.173179 Jun 21 19:09:10.419922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 309/628] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:10 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:11.317359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:11.317978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:11.326264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:11.326264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:11.326954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:11.327383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:11.392174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:11.399733 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2ddd5bc0-6b2e-49a2-9449-e1498b47b3e7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1201 microversion: 2.1 time: 0.086557 Jun 21 19:09:11.400299 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 320/629] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:11 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:11.437000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:11.437658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:11.444576 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:11.445016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:11.445815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:11.446810 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:11.584626 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:11.593415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9c96d924-6b3c-484c-a13a-108e5633398b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.160099 Jun 21 19:09:11.594021 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 310/630] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:11 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:12.418882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:12.419924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:12.428045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:12.428791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:12.430001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:12.430606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:12.555828 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:12.565602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f2a03e50-4030-4e76-824c-67ab7d785064 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1211 microversion: 2.1 time: 0.152607 Jun 21 19:09:12.566345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 321/631] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:12 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:12.614797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:12.616103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:12.627537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:12.628376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:12.629942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:12.630771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:12.948016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:12.958281 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a49c58de-04f5-44a2-9cba-fa0ddc4065ab tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.349986 Jun 21 19:09:12.958872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 311/632] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:12 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:13.585638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:13.586435 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:13.594129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:13.594645 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:13.595553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:13.595999 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:13.827689 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:13.836891 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-37bebd16-7224-4820-a43c-932547e86665 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.255091 Jun 21 19:09:13.837640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 322/633] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:13 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:13.980071 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:13.981357 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:13.993122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:13.994332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:13.996102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:13.997232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:14.026439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:14.027195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:14.035450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:14.036274 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:14.037157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:14.037615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:14.158925 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'services' on Instance uuid aace36d9-074e-4abc-ab0b-29741c447ef4 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:14.276718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-61a4e160-dc0f-45f4-ad43-2d6fd9ef92e5 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4/os-volume_attachments/777c1999-5ec1-4faa-990d-d61a32004728" status: 202 len: 0 microversion: 2.1 time: 0.254343 Jun 21 19:09:14.277449 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 323/634] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:09:14 2022] DELETE /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4/os-volume_attachments/777c1999-5ec1-4faa-990d-d61a32004728 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:09:14.285983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c1b759e3-912e-4066-af92-5f15e60f7326 req-dfe7fe4e-c997-4c92-9b9e-4d3083fe5e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f8ce3-ce32-4edb-9ab3-b10bb2efc36c", "tag": "111addab-171e-4b55-ac0c-859ba5bac005"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:14.286995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:14.303088 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c1b759e3-912e-4066-af92-5f15e60f7326 req-dfe7fe4e-c997-4c92-9b9e-4d3083fe5e00 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:14.304194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4cf91ca3-3ef2-4038-84ad-7c63c930bdf9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1736 microversion: 2.1 time: 0.331690 Jun 21 19:09:14.306359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 312/635] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:13 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:14.306543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c1b759e3-912e-4066-af92-5f15e60f7326 req-dfe7fe4e-c997-4c92-9b9e-4d3083fe5e00 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:14.331358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c1b759e3-912e-4066-af92-5f15e60f7326 req-dfe7fe4e-c997-4c92-9b9e-4d3083fe5e00 service nova] Creating event network-changed:111addab-171e-4b55-ac0c-859ba5bac005 for instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c on hv-cinder-84630 Jun 21 19:09:14.343654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c1b759e3-912e-4066-af92-5f15e60f7326 req-dfe7fe4e-c997-4c92-9b9e-4d3083fe5e00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061049 Jun 21 19:09:14.344819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 324/636] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:14.854584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:14.855104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:14.861372 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:14.861825 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:14.862594 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:14.863031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.002063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:15.004236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:15.011333 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a0e47454-9684-4d42-990d-f0a9d7a34e72 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.160642 Jun 21 19:09:15.011909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 313/637] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:14 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:15.324931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:15.325679 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:15.333136 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.333575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.334666 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.335116 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.532405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:15.541040 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a11520cf-5c20-4f32-9719-b36f5828d974 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1716 microversion: 2.1 time: 0.221396 Jun 21 19:09:15.541631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 325/638] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:15 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1716 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:15.600590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:15.601123 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:15.608168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.608623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.609421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.609866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.739968 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] HTTP exception thrown: Cannot 'detach_volume' instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 while it is in vm_state rescued Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Request method failure captured: Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments/ecea6540-a7e5-4085-99ca-a0abb83b65a1 HTTP/1.1 Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXfUWYtwzET13jYr4x56YwZuTLxo0CDv4HddLZc4o7eFmNzs1DxEKsJkkFVNRXCAy82jPr_KMvFBaBt63-ltRvZO7EorHFSRyGcA_wU0CcdnaPEZk1P_JVdSQIWJTV2-2GQHj_5MXCoWd_4qF7TOQ1jc-BTKFhSGapYk2B9Hk4i6kE Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:09:15.741622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}] Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: eeafe22d22f648d6aefcc6a308d4fc0d Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:09:15.743278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Cannot 'detach_volume' instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 while it is in vm_state rescued Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': 'e2aadfbd-a71b-448b-8184-8fb08a9a1ce9', 'id': 'ecea6540-a7e5-4085-99ca-a0abb83b65a1'} Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:09:15.744034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 while it is in vm_state rescued Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 while it is in vm_state rescued Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:09:15.745700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Returning 409 to user: Cannot 'detach_volume' instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 while it is in vm_state rescued {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:09:15.746956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-172955ed-ef50-4561-bf4f-3cbade7c87af tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments/ecea6540-a7e5-4085-99ca-a0abb83b65a1" status: 409 len: 152 microversion: 2.1 time: 0.146492 Jun 21 19:09:15.746956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 314/639] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:09:15 2022] DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments/ecea6540-a7e5-4085-99ca-a0abb83b65a1 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 19:09:15.752227 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:15.752771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:15.762072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.762573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.763515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.763988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.835810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9dba8748-2f2c-4020-afdc-0e1d7e3ee730 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/action" status: 202 len: 0 microversion: 2.1 time: 0.087364 Jun 21 19:09:15.837033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 326/640] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:09:15 2022] POST /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:09:15.847081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:15.847846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:15.858731 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.859188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:15.859976 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:15.860414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.001306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:16.014793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e921480f-c468-4148-9f96-13b1689169c2 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.172984 Jun 21 19:09:16.015463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 315/641] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:15 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:16.028358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:16.029062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:16.036879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.037671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.038729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.039360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.178822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:16.186893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ae6cbfcb-2f5a-46df-a307-9b74d4e5bd2c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.162735 Jun 21 19:09:16.187473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 327/642] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:16 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:16.547420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:16.547929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:16.554024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.554472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.555237 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.555676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.583839 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:09:16.666332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-017a7972-e91d-457b-9586-f988e8318abd tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 204 len: 0 microversion: 2.1 time: 0.122467 Jun 21 19:09:16.666911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 316/643] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:09:16 2022] DELETE /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:09:16.675032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:16.675702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:16.682868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.683324 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.684190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:16.684634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:16.878899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:16.887369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1d2da1f7-a530-4d26-a695-9d8c196eba07 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1512 microversion: 2.1 time: 0.216142 Jun 21 19:09:16.887940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 328/644] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:16 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:17.038148 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:17.038844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:17.041373 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:17.042033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:17.048188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.048634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:17.049432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.049863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:17.187829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:17.196241 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a63b372c-55b9-4ca8-abef-ec7035d1337f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.162227 Jun 21 19:09:17.196822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 317/645] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:17 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:17.203905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:17.204600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:17.206889 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:17.213564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.214137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:17.215128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.215858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:17.365414 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:17.373894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2c8f787a-d431-4cc7-86b6-aa465e9b9d52 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.173858 Jun 21 19:09:17.374467 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 329/646] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:17 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:17.905170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:17.905784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:17.912171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.912630 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:17.913455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:17.913901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:18.048557 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:18.056325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-df7c518c-15a5-4ac4-b041-4e8efdf6ab52 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1512 microversion: 2.1 time: 0.154932 Jun 21 19:09:18.056903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 318/647] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:17 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:18.214570 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:18.215454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:18.222410 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:18.222869 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:18.223667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:18.224115 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:18.390876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:18.391787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:18.401484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:18.402031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:18.403223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:18.403788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:18.604178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:18.607199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:18.617019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9bb797b-62a0-4c43-8984-67ade6bc2b47 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.406379 Jun 21 19:09:18.618344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 330/648] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:18 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:18.722894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:18.733221 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0611821c-01d8-423c-95c4-7ca949886193 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.346054 Jun 21 19:09:18.733979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 319/649] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:18 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:19.074088 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:19.074713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:19.082314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.082759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:19.083534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.083967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:19.635645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:19.636294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:19.643154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.643603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:19.644389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.644821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:19.842390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:19.850321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0cd67635-8f39-48ad-9784-39f5739faf01 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1512 microversion: 2.1 time: 0.780133 Jun 21 19:09:19.850823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 331/650] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:19 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1512 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:19.855591 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:19.856212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:19.863500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.863952 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:19.864745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:19.865223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:20.144779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:20.157646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-442bebfa-b837-40e0-9ed6-fe2d35ca1ee5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.525913 Jun 21 19:09:20.158037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 320/651] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:19 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:20.191873 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:20.201495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-652ffcbe-4151-4360-814c-0993e145e508 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.349498 Jun 21 19:09:20.202345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 332/652] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:19 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:20.365853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-beb42ffd-d5f6-4a15-96c1-fcc0f496184d req-ec660775-7cae-40be-bb06-e85c153fbb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace36d9-074e-4abc-ab0b-29741c447ef4", "name": "network-vif-deleted", "tag": "702fcd04-047d-455c-b85a-0b7394a32144"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:20.375807 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-beb42ffd-d5f6-4a15-96c1-fcc0f496184d req-ec660775-7cae-40be-bb06-e85c153fbb7a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:20.376168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-beb42ffd-d5f6-4a15-96c1-fcc0f496184d req-ec660775-7cae-40be-bb06-e85c153fbb7a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:20.388293 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-beb42ffd-d5f6-4a15-96c1-fcc0f496184d req-ec660775-7cae-40be-bb06-e85c153fbb7a service nova] Creating event network-vif-deleted:702fcd04-047d-455c-b85a-0b7394a32144 for instance aace36d9-074e-4abc-ab0b-29741c447ef4 on hv-cinder-84630 Jun 21 19:09:20.394983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-beb42ffd-d5f6-4a15-96c1-fcc0f496184d req-ec660775-7cae-40be-bb06-e85c153fbb7a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Jun 21 19:09:20.396066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 321/653] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:20.867949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:20.868571 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:20.875944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:20.876360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:20.877181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:20.877624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:20.911368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:20.911812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:20.912282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid aace36d9-074e-4abc-ab0b-29741c447ef4 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:20.959313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:20.967654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a3f3c24d-b5e4-4316-9aa3-e4139c49fef7 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1307 microversion: 2.1 time: 0.103702 Jun 21 19:09:20.968233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 333/654] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:20 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:21.176881 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:21.177604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:21.184422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.184872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:21.185680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.186107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:21.218776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:21.219418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:21.225580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.226027 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:21.226798 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.227223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:21.390188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:21.399153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b47aa19-6561-4c17-b28c-948a1e6aa8b0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.226837 Jun 21 19:09:21.399791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 322/655] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:21 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:21.417254 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:21.424706 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-39df13dd-4fed-47c8-a974-d0b25cfe9d0d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.209757 Jun 21 19:09:21.425294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 334/656] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:21 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:21.984738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:21.985392 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:21.993066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.993597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:21.994441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:21.994940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.029063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:22.029551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.030024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid aace36d9-074e-4abc-ab0b-29741c447ef4 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:22.073797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:22.081912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-19026021-e2ee-478f-aa9f-4d51fee6bac3 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1307 microversion: 2.1 time: 0.100941 Jun 21 19:09:22.082785 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 323/657] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:21 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:22.418003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:22.418931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:22.425511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:22.425964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.426742 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:22.427182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.442316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:22.443338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:22.450901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:22.451364 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.452147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:22.452590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:22.644767 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:22.653785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2583de57-94d5-4d87-b674-4e691bebc17e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.240155 Jun 21 19:09:22.654378 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 335/658] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:22 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:22.660294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:22.668834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c0fb9f00-df31-4130-9b45-31a26bb078ca tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.230622 Jun 21 19:09:22.669495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 324/659] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:22 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:23.099768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:23.100382 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:23.107282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.107727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.108488 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.108924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.140418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.140863 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.141355 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid aace36d9-074e-4abc-ab0b-29741c447ef4 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:23.182337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:23.190085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-615845e4-59e2-4c28-9172-bb054b0b0b18 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1307 microversion: 2.1 time: 0.094001 Jun 21 19:09:23.190639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 336/660] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:23 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:23.671577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:23.672280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:23.680198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.680975 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.682334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.682992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.687524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:23.689777 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:23.697359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.697816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.698599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:23.699041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:23.890626 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:23.898970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b095f12b-8814-4937-8493-ec0f18a7b37b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1724 microversion: 2.1 time: 0.231690 Jun 21 19:09:23.899564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 325/661] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:23 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:23.899752 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:23.907840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fb41288a-b0df-468b-a231-d862ae2ae052 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.224412 Jun 21 19:09:23.908404 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 337/662] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:23 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:24.206820 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:24.207439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:24.214345 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.214801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.215580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.216016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.247997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.248443 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.248898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lazy-loading 'fault' on Instance uuid aace36d9-074e-4abc-ab0b-29741c447ef4 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:24.294503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60db31dcc6944f63b078d2893640e0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8ecb9ed854cf28de16f950daf39e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:24.304903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-974a0403-e5e7-4bf5-b063-ca2d9aca89e0 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 200 len: 1307 microversion: 2.1 time: 0.101870 Jun 21 19:09:24.305778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 326/663] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:24 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:24.917734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:24.918623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:24.926235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:24.927130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.927319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:24.927494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.928236 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.928790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.933050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.933519 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:24.934283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:24.934718 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:25.180275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:25.190853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c386f219-bc1b-4fdd-98a7-34b936c1e62a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.268480 Jun 21 19:09:25.191612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 327/664] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:24 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:25.202540 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:25.213652 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fb717a54-5ae8-427b-9460-256418421a09 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1730 microversion: 2.1 time: 0.300552 Jun 21 19:09:25.214263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 338/665] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:24 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:25.231604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:25.232104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:25.238306 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:25.238757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:25.239527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:25.239961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:25.321472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf158a51-d0a2-4f69-ba2f-ce222696ad9e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093358 Jun 21 19:09:25.322707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 328/666] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:09:25 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:25.325459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:25.326950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] [instance: aace36d9-074e-4abc-ab0b-29741c447ef4] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:25.338049 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:25.338823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:25.340189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:25.340964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:25.366745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] HTTP exception thrown: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Request method failure captured: Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 HTTP/1.1 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABisha5DEtWuhYuTQsyHf9jwbpnlNkuoBaM9rBfWwaXGjQJSW9T8fr6zd_JCCakF00Vp6HDi6GepveTS--CafLSdaiDCQ5-EI3JHxo0IaBT7sHwUS5b1g_wSJ5HyHsBgmx_rQ7rebGRKwaJEkNb9GbeUqDHj0VsRpx4ZedNESDcH2hHXCQ Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: f9f8ecb9ed854cf28de16f950daf39e5 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:09:25.369927 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f9f8ecb9ed854cf28de16f950daf39e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f9f8ecb9ed854cf28de16f950daf39e5"}]}] Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: f9f8ecb9ed854cf28de16f950daf39e5 Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1352601315 Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotTestJSON-1352601315-project Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 60db31dcc6944f63b078d2893640e0b8 Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotTestJSON-1352601315-project Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. Jun 21 19:09:25.371368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'aace36d9-074e-4abc-ab0b-29741c447ef4'} Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:09:25.372129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. Jun 21 19:09:25.373618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:09:25.375454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] Returning 404 to user: Instance aace36d9-074e-4abc-ab0b-29741c447ef4 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:09:25.375454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0b200a7e-8d3b-47d8-a073-3f29ca6e8a83 tempest-VolumesSnapshotTestJSON-1352601315 tempest-VolumesSnapshotTestJSON-1352601315-project] 10.222.0.70 "GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4" status: 404 len: 111 microversion: 2.1 time: 0.053611 Jun 21 19:09:25.375454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 339/667] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:25 2022] GET /compute/v2.1/servers/aace36d9-074e-4abc-ab0b-29741c447ef4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:09:26.212784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:26.213392 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:26.219733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:26.220431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:26.221246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:26.221692 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:26.224699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:26.531348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:26.548644 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fa303afc-9b74-4b88-ab85-266406aebbf4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.340043 Jun 21 19:09:26.549487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 329/668] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:26 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:26.594899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-429cf591-6da9-487c-aa21-3115cbfaeb04 req-d1b5efdf-8964-47a4-9556-59ee51bc5ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:26.605676 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-429cf591-6da9-487c-aa21-3115cbfaeb04 req-d1b5efdf-8964-47a4-9556-59ee51bc5ea9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:26.606105 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-429cf591-6da9-487c-aa21-3115cbfaeb04 req-d1b5efdf-8964-47a4-9556-59ee51bc5ea9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:26.618942 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-429cf591-6da9-487c-aa21-3115cbfaeb04 req-d1b5efdf-8964-47a4-9556-59ee51bc5ea9 service nova] Creating event network-changed:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:09:26.624560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-429cf591-6da9-487c-aa21-3115cbfaeb04 req-d1b5efdf-8964-47a4-9556-59ee51bc5ea9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033368 Jun 21 19:09:26.625806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 340/669] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:27.570969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:27.572062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:27.576316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:27.587043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:27.587866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:27.589488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:27.590218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:27.752434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:27.760998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ae546f54-8f1e-44b4-955d-0f38a4276ad9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.197263 Jun 21 19:09:27.761541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 330/670] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:27 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:28.641311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-18ac3cc1-0a65-415e-914c-3a0d8d1e3d73 req-45180934-169e-4375-bd74-8bc8f0001669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:28.644759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=78 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:28.651522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-18ac3cc1-0a65-415e-914c-3a0d8d1e3d73 req-45180934-169e-4375-bd74-8bc8f0001669 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:28.651959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-18ac3cc1-0a65-415e-914c-3a0d8d1e3d73 req-45180934-169e-4375-bd74-8bc8f0001669 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:28.664758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-18ac3cc1-0a65-415e-914c-3a0d8d1e3d73 req-45180934-169e-4375-bd74-8bc8f0001669 service nova] Creating event network-changed:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:09:28.671353 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-18ac3cc1-0a65-415e-914c-3a0d8d1e3d73 req-45180934-169e-4375-bd74-8bc8f0001669 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034265 Jun 21 19:09:28.672160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 341/671] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:28.778268 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:28.778886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:28.786045 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:28.786527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:28.787309 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:28.787749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:28.934271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:28.947340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d6a970d1-4741-4fa4-913d-bd6bb653c5c7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.172503 Jun 21 19:09:28.948275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 331/672] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:28 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:29.966137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:29.967140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:29.974332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:29.974785 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:29.975573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:29.976015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:30.050782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:30.051376 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:30.058772 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:30.059234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:30.060023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:30.060464 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:30.143585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:30.148723 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lazy-loading 'services' on Instance uuid 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:09:30.153503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f10c225f-de9f-4191-afdd-1f41cbfb7d70 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.191587 Jun 21 19:09:30.162111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 332/673] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:29 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:30.229416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8e8c8689-1d3c-477c-931d-08ae9dc240ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments/6af4568d-1963-4799-82fa-6fc695b9faf2" status: 202 len: 0 microversion: 2.1 time: 0.304601 Jun 21 19:09:30.230246 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 342/674] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:09:29 2022] DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments/6af4568d-1963-4799-82fa-6fc695b9faf2 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:09:31.169986 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:31.170815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:31.177402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:31.177848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:31.178633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:31.179071 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:31.365368 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:31.373305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b594553c-951a-43a5-b386-d3d506c2e2f3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.207021 Jun 21 19:09:31.373889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 333/675] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:31 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:31.774742 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-416b4974-c477-455b-9c69-8ed53fca175c req-79f59277-3c25-4840-8300-cf0a46847e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8ce3-ce32-4edb-9ab3-b10bb2efc36c", "name": "network-vif-plugged", "status": "completed", "tag": "111addab-171e-4b55-ac0c-859ba5bac005"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:31.788379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-416b4974-c477-455b-9c69-8ed53fca175c req-79f59277-3c25-4840-8300-cf0a46847e4c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:31.789236 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-416b4974-c477-455b-9c69-8ed53fca175c req-79f59277-3c25-4840-8300-cf0a46847e4c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:31.803035 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-416b4974-c477-455b-9c69-8ed53fca175c req-79f59277-3c25-4840-8300-cf0a46847e4c service nova] Creating event network-vif-plugged:111addab-171e-4b55-ac0c-859ba5bac005 for instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c on hv-cinder-84630 Jun 21 19:09:31.810000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-416b4974-c477-455b-9c69-8ed53fca175c req-79f59277-3c25-4840-8300-cf0a46847e4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039969 Jun 21 19:09:31.810799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 343/676] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:09:32.392585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:32.393557 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:32.401568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:32.402250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:32.403025 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:32.403461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:32.481531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6ab7656a-700d-4680-8c0a-b3ce98194cda tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:32.488036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ab7656a-700d-4680-8c0a-b3ce98194cda tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:32.488477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ab7656a-700d-4680-8c0a-b3ce98194cda tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:32.513892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6ab7656a-700d-4680-8c0a-b3ce98194cda tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Going to try to stop instance {{(pid=117619) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 19:09:32.566661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6ab7656a-700d-4680-8c0a-b3ce98194cda tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action" status: 202 len: 0 microversion: 2.1 time: 0.089576 Jun 21 19:09:32.567575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 344/677] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:09:32 2022] POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:09:32.578622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:32.579508 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:32.594328 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:32.594792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:32.595600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:32.596030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:32.953664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:32.962930 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f5194e4-1425-4dc0-9f28-98d7bdf3c97c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1267 microversion: 2.1 time: 0.575523 Jun 21 19:09:32.973168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 334/678] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:32 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1267 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:33.028312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:33.036004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d87ab869-8fa3-4594-8f34-7d6eb7911d49 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.463032 Jun 21 19:09:33.036583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 345/679] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:32 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:33.445561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:09:33.447452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:09:33.982996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:33.983617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:33.990583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:33.991038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:33.991819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:33.992266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:34.055047 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:34.055766 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:34.062646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:34.063114 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:34.063895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:34.064726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:34.186325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:34.195329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3ec3bca0-550b-4bb1-8de4-cdf0667d59d5 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1455 microversion: 2.1 time: 0.216114 Jun 21 19:09:34.196073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 335/680] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:33 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1455 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:34.215041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:34.215909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:34.224414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:34.225216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:34.226783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:34.227413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:34.238030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:34.247680 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b4efc64d-64f2-4979-af1f-c5ed2dd3cd7c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.196446 Jun 21 19:09:34.249714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 346/681] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:34 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:34.403827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:34.415689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-137cd111-ba6b-4931-b3c1-c366515c640a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1455 microversion: 2.1 time: 0.205741 Jun 21 19:09:34.416691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 336/682] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:34 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1455 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:35.271102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:35.272219 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:35.283319 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:35.284107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:35.285455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:35.286233 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:35.527228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:35.529446 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:09:35.540148 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8c3f790b-4a8c-4d17-ae5b-5f0e90d41cdf tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.276066 Jun 21 19:09:35.540743 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 347/683] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:35 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:36.362680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-23dd7278-1094-49d7-88d9-409c10231ff7 req-24e10e26-c15f-4dc5-913b-f68b015048b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f8ce3-ce32-4edb-9ab3-b10bb2efc36c", "tag": "111addab-171e-4b55-ac0c-859ba5bac005"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:36.371607 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23dd7278-1094-49d7-88d9-409c10231ff7 req-24e10e26-c15f-4dc5-913b-f68b015048b2 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:36.372233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23dd7278-1094-49d7-88d9-409c10231ff7 req-24e10e26-c15f-4dc5-913b-f68b015048b2 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:36.384998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-23dd7278-1094-49d7-88d9-409c10231ff7 req-24e10e26-c15f-4dc5-913b-f68b015048b2 service nova] Creating event network-changed:111addab-171e-4b55-ac0c-859ba5bac005 for instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c on hv-cinder-84630 Jun 21 19:09:36.391039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-23dd7278-1094-49d7-88d9-409c10231ff7 req-24e10e26-c15f-4dc5-913b-f68b015048b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Jun 21 19:09:36.393043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 337/684] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:09:36.562405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:36.563563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:36.579856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:36.580660 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:36.582383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:36.583177 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:36.845175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:36.854774 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2aa13664-b643-4f60-995f-08a4e7d83c51 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.300857 Jun 21 19:09:36.855658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 348/685] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:36 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:37.883992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:37.884616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:37.890944 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:37.891397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:37.892171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:37.892604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:38.029961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:38.037525 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-eab1475a-9040-41dc-b333-9032a3e6110a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.159247 Jun 21 19:09:38.038096 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 338/686] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:37 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:39.056188 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:39.056914 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:39.065557 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:39.066186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:39.067026 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:39.067702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:39.224998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:39.232778 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ce733c1e-5900-45d7-a047-e38e154f0a6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.181589 Jun 21 19:09:39.233384 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 349/687] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:39 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:40.249934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:40.250783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:40.258025 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:40.258472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:40.259255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:40.259703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:40.424395 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:40.431989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-56767dc6-465f-4996-9ee2-88734d1e3d6e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.185952 Jun 21 19:09:40.432555 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 339/688] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:40 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:41.449592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:41.450190 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:41.456748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:41.457232 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:41.458003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:41.458441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:41.600878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:41.608442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-12b2b9a1-0ae5-49b9-af87-16b3df6db933 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.162863 Jun 21 19:09:41.609010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 350/689] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:41 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:42.625969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:42.626561 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:42.633458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:42.633910 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:42.634685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:42.635122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:42.771044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:42.780756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d7212e74-f475-4b45-8066-62fbc820ec8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.158609 Jun 21 19:09:42.781505 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 340/690] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:42 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:43.804451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:43.805120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:43.812692 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:43.813181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:43.813979 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:43.814710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:43.956944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:43.964710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f84528eb-ef00-4120-bd54-3b78d894f62c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.164627 Jun 21 19:09:43.965309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 351/691] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:43 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:44.982679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:44.983292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:44.989975 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:44.990450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:44.991224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:44.992299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:45.135252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:45.143069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b6e9da33-9e67-4e1f-a0d6-b7d169767112 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.164225 Jun 21 19:09:45.143643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 341/692] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:44 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:46.161011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:46.161952 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:46.168641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:46.169121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:46.169895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:46.170328 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:46.386204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:46.395214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-998fea89-b6d3-49a7-abc1-d024cc31e7cc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.237968 Jun 21 19:09:46.396155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 352/693] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:46 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:47.412999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:47.413744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:47.421663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:47.422201 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:47.423082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:47.423623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:47.563879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:47.572915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e502ea98-5148-4629-8f39-b82fad42777c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1676 microversion: 2.1 time: 0.163827 Jun 21 19:09:47.573551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 342/694] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:47 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:48.590677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:48.591300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:48.598328 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:48.598782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:48.599559 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:48.599991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:48.735974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:48.743595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-05e54e3f-c4a5-41b4-aa36-ca7cc9a50503 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1653 microversion: 2.1 time: 0.156944 Jun 21 19:09:48.744157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 353/695] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:48 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:48.760761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-85627f34-2d9f-4bbc-8d4d-43dc6f4ea6b0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:09:48.767441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85627f34-2d9f-4bbc-8d4d-43dc6f4ea6b0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:48.767886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-85627f34-2d9f-4bbc-8d4d-43dc6f4ea6b0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:48.792716 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-85627f34-2d9f-4bbc-8d4d-43dc6f4ea6b0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Going to try to start instance {{(pid=117618) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 19:09:48.840111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-85627f34-2d9f-4bbc-8d4d-43dc6f4ea6b0 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action" status: 202 len: 0 microversion: 2.1 time: 0.083434 Jun 21 19:09:48.844362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 343/696] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:09:48 2022] POST /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:09:48.853438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:48.854637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:48.865149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:48.865998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:48.867707 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:48.868450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:49.065155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:49.080315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aa5c06b6-ff81-45ec-af56-dc0a759f40fb tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1662 microversion: 2.1 time: 0.233606 Jun 21 19:09:49.081524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 354/697] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:48 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1662 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:09:50.111905 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:50.112620 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:50.119756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:50.120203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:50.120983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:50.121452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:50.291351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:50.299403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-809e2ab1-59c4-4609-92f6-c21197d471b3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1662 microversion: 2.1 time: 0.191662 Jun 21 19:09:50.300061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 344/698] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:50 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1662 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:09:51.317635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:09:51.318259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:09:51.326709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:51.326862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:51.327646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:09:51.328077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:09:51.462620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:09:51.470494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8b6386af-cdd4-48cf-8242-13184636de05 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1666 microversion: 2.1 time: 0.156935 Jun 21 19:09:51.471076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 355/699] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:09:51 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:10.126164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:10.126817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:10.129169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=29 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:10.129834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:10.135777 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.136211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.137007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.137464 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.169543 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-75468d27-e621-4b05-94c8-37353bdcde1b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments/276131b4-b683-47a5-a501-8ccb537eb57e" status: 200 len: 194 microversion: 2.20 time: 0.047150 Jun 21 19:10:10.170211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 345/700] 10.222.0.70 () {60 vars in 1453 bytes} [Tue Jun 21 19:10:10 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments/276131b4-b683-47a5-a501-8ccb537eb57e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:10:10.235455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:10.236009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:10.238953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=29 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:10.239805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=49 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:10.247193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.247761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.248971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.249138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.332056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lazy-loading 'services' on Instance uuid 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:10:10.403804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-70765200-028b-43b1-a812-39807394ed3b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments/276131b4-b683-47a5-a501-8ccb537eb57e" status: 202 len: 0 microversion: 2.20 time: 0.172705 Jun 21 19:10:10.404398 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 356/701] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jun 21 19:10:10 2022] DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments/276131b4-b683-47a5-a501-8ccb537eb57e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:10:10.413452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:10.414563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:10.420853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.421508 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.422378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:10.422830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:10.456535 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6c78438d-98f7-4e1b-80fa-b7be2e72cbc9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047276 Jun 21 19:10:10.457339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 346/702] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 19:10:10 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:10:11.470487 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:11.471579 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:11.478979 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.479427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.480248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.480691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.512480 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-98711c59-f577-427b-949f-b7148d214bf9 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046919 Jun 21 19:10:11.513061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 357/703] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 19:10:11 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:11.572028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:11.572605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:11.579085 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.579527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.580300 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.580742 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.606192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:10:11.684005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1a7d8f82-71b5-4ff1-85a3-0e78bf5b7d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 204 len: 0 microversion: 2.20 time: 0.116108 Jun 21 19:10:11.684740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 347/704] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 19:10:11 2022] DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 19:10:11.694761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:11.695378 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:11.701363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.701812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.702607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:11.703030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:11.836476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:11.845359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:11.846896 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:11.848053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2b7b9b40-3c34-4463-9f8e-42c4d26e2c53 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.158898 Jun 21 19:10:11.848606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 358/705] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:11 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:12.868014 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:12.868709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:12.875069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:12.875513 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:12.876266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:12.876698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:13.009526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:13.017348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:13.018835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:13.019981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-927f1e87-0b8b-4846-b641-7296cabbee68 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.156878 Jun 21 19:10:13.020530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 348/706] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:12 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:14.040012 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:14.041107 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:14.048205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:14.048743 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:14.049695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:14.050134 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:14.253441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:14.262087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:14.263594 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:14.264795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6d0e99ff-c88d-4252-9ee4-84b27b6cf2bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 200 len: 1721 microversion: 2.20 time: 0.230072 Jun 21 19:10:14.265414 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 359/707] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:14 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:14.578738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-365c4f87-4416-48dd-8cb4-d6a9da4b879d req-51462fb1-cb6f-4c78-bc4b-5ffabb648ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f90611c-b33b-4c4d-9a8d-95d86d8104c8", "name": "network-vif-deleted", "tag": "10acc951-c393-4b0d-ac92-f42e7345376a"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:14.590616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-365c4f87-4416-48dd-8cb4-d6a9da4b879d req-51462fb1-cb6f-4c78-bc4b-5ffabb648ac7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:14.591209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-365c4f87-4416-48dd-8cb4-d6a9da4b879d req-51462fb1-cb6f-4c78-bc4b-5ffabb648ac7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:14.604645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-365c4f87-4416-48dd-8cb4-d6a9da4b879d req-51462fb1-cb6f-4c78-bc4b-5ffabb648ac7 service nova] Creating event network-vif-deleted:10acc951-c393-4b0d-ac92-f42e7345376a for instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 on hv-cinder-84630 Jun 21 19:10:14.615460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-365c4f87-4416-48dd-8cb4-d6a9da4b879d req-51462fb1-cb6f-4c78-bc4b-5ffabb648ac7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036043 Jun 21 19:10:14.616104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 349/708] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:15.284051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:15.284660 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:15.291282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:15.291727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:15.292498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:15.292933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:15.307427 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 HTTP/1.1 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:10:15.309109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:10:15.310984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '0f90611c-b33b-4c4d-9a8d-95d86d8104c8'} Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:10:15.311936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:10:15.313294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:15.315323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:10:15.315323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-008de8cf-47ce-4675-a70f-eda16ff37141 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 404 len: 111 microversion: 2.20 time: 0.030420 Jun 21 19:10:15.315323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 360/709] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:15 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:10:15.321083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b3a6127d-909b-4382-9d66-adf599e6566c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '.version_select at 0x7f359580baf0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:15.344541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b3a6127d-909b-4382-9d66-adf599e6566c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681063432" status: 204 len: 0 microversion: 2.20 time: 0.028184 Jun 21 19:10:15.345420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 350/710] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jun 21 19:10:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681063432 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 19:10:15.980635 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-98911478-00c3-42ab-9228-261462838df4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: .version_select at 0x7f3595915e50>, body: {"keypair": {"name": "tempest-keypair-1022877665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzn4GIV4uoJa8YB2by3HIUFWAo407ydD0nYRE3+B8RSptsel3+76P+oVTIM0XOn7b7SeAFZenqzJwmRgpwqX2lQIdLLh2YD5X3ZhYT13sKvwQwfhWPMWv8s7KpHwSsAww=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:15.994460 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-98911478-00c3-42ab-9228-261462838df4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:10:15.998311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-98911478-00c3-42ab-9228-261462838df4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for user b6ce650c0ae6494ab895644347bbb5b7 and project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:10:16.025477 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-98911478-00c3-42ab-9228-261462838df4 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048741 Jun 21 19:10:16.026209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 361/711] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jun 21 19:10:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 21 19:10:16.452291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:16.453191 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:16.463217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:16.463593 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:16.464375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:16.464882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:16.487624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lazy-loading 'flavor' on Instance uuid cc26e7fb-be01-453e-b8bc-098c1312dde5 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:10:16.562431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-80e37c69-ef91-44c7-8194-8c6bfafeb5e6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "POST /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5/action" status: 202 len: 0 microversion: 2.1 time: 0.114262 Jun 21 19:10:16.563487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 351/712] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:10:16 2022] POST /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:10:16.572962 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:16.574361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:16.581854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:16.582537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:16.583653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:16.585763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:16.830564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:16.838207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3c9ec1d5-8a39-4f99-a4fd-3c81d875652f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.270566 Jun 21 19:10:16.838785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 362/713] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:16 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:17.430284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-711614298", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c4d315c-7943-4b0e-9c96-174194be76a6"}], "security_groups": [{"name": "tempest-securitygroup--1213262783"}], "key_name": "tempest-keypair-1022877665", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:17.529893 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] validate_networks() for [('2c4d315c-7943-4b0e-9c96-174194be76a6', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:10:17.856117 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:17.856753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:17.863268 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:17.863714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:17.864470 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:17.864905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:17.914009 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:10:17.914431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:10:17.914902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:10:17.915312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:10:17.915723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:10:17.924573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:17.925020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:17.925847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:17.927010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:17.943460 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:10:17.948023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Getting quotas for user b6ce650c0ae6494ab895644347bbb5b7 and project 0e052c1c726e48ea98ee7b21c3cd55d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:10:17.959094 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:10:17.962410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:10:18.001469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:18.008798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-63e7d91f-febd-4d15-aa0a-130c3e11839b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.583059 Jun 21 19:10:18.009707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 352/714] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jun 21 19:10:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 19:10:18.010993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c7b4b9c1-d43e-4da3-b17c-2ebe921fa834 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.158744 Jun 21 19:10:18.011698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 363/715] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:17 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:18.019170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:18.019780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:18.073641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:18.082152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:18.083648 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:18.084793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6e9c6688-4a9f-4cd5-9e80-f1b0cbd58c94 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1281 microversion: 2.20 time: 0.069408 Jun 21 19:10:18.085384 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 353/716] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:18 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:10:19.027888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:19.028500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:19.035296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:19.035745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:19.037178 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:19.037892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:19.103116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:19.103871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:19.110719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:19.111405 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:19.112181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:19.113197 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:19.210180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:19.219840 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:19.221378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:19.222510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf31fb6f-fd75-4315-a494-b58ec372c06b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1339 microversion: 2.20 time: 0.123533 Jun 21 19:10:19.223074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 354/717] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:19 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:19.303961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:19.311566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-524ea891-84f5-4165-b689-6e745fe224b5 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.287477 Jun 21 19:10:19.312139 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 364/718] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:19 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:20.241792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:20.242627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:20.250160 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:20.250903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:20.251696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:20.252137 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:20.329836 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:20.331468 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:20.339114 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:20.339797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:20.340581 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:20.341017 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:20.507886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:20.516889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:20.518413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:20.519749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4168fbc3-da20-4503-b6d6-aa8712f019c6 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.282106 Jun 21 19:10:20.520315 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 355/719] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:20 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:10:20.609634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-23a54ff9-dc63-42cf-8728-0a062c3aeaad req-608fc5f8-a316-43e8-8fa6-ea60fd25b9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:20.620673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:20.621237 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23a54ff9-dc63-42cf-8728-0a062c3aeaad req-608fc5f8-a316-43e8-8fa6-ea60fd25b9fa service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:20.622624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-23a54ff9-dc63-42cf-8728-0a062c3aeaad req-608fc5f8-a316-43e8-8fa6-ea60fd25b9fa service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:20.643441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-23a54ff9-dc63-42cf-8728-0a062c3aeaad req-608fc5f8-a316-43e8-8fa6-ea60fd25b9fa service nova] Creating event network-changed:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:10:20.649050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-23a54ff9-dc63-42cf-8728-0a062c3aeaad req-608fc5f8-a316-43e8-8fa6-ea60fd25b9fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044223 Jun 21 19:10:20.649898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 356/720] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:10:20.653404 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-601d735b-082d-4a6a-bbcd-2acbb3c7e4a3 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.329021 Jun 21 19:10:20.654041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 365/721] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:20 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:21.539669 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:21.540359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:21.546741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:21.547187 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:21.547937 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:21.548379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:21.671062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:21.671702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:21.678341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:21.678788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:21.679555 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:21.679991 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:21.680343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:21.688987 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:21.690767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:21.691878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-22b3c9b8-ded0-44d5-9861-a412934aa5fa tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.156897 Jun 21 19:10:21.692428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 357/722] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:21 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:21.820512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:21.830265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d5962cf2-68a4-4bd3-b333-42bb4b50ec02 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.163118 Jun 21 19:10:21.831022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 366/723] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:21 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:22.711044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:22.711652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:22.718134 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:22.718575 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:22.719334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:22.719762 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:22.847803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:22.848412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:22.855846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:22.856332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:22.856782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:22.857584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:22.858014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:22.869940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:22.871479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:22.872632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-986c6f8a-ae23-427d-8184-85a68d10a837 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.166275 Jun 21 19:10:22.873413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 358/724] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:22 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:22.994472 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:23.002421 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e25dacab-3538-45f0-9c44-9effcd9eebb8 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.158392 Jun 21 19:10:23.003010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 367/725] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:22 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:23.890694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:23.891454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:23.897815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:23.898258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:23.899026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:23.899453 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:24.020048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:24.020843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:24.028003 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:24.028558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:24.029497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:24.030010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:24.037965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:24.046253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:24.047767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:24.048893 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5df92b73-4fea-4426-9aef-8ebb9670bb2b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.162221 Jun 21 19:10:24.049472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 359/726] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:23 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:24.170500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:24.177976 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-02ac73d4-3a3f-412a-9ab5-4f17c7e92742 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.161937 Jun 21 19:10:24.178544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 368/727] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:24 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:25.067775 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:25.069166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:25.075395 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:25.075845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:25.076622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:25.077062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:25.195936 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:25.196558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:25.203412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:25.203858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:25.204669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:25.205144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:25.219769 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:25.229074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:25.230622 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:25.231781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-50f78e93-8fb9-43bc-aaaf-04225523119c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.168357 Jun 21 19:10:25.232352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 360/728] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:25 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:25.346852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:25.355029 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8573db16-baa6-4f57-ac04-c6253339a671 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.163699 Jun 21 19:10:25.355591 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 369/729] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:25 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:25.944337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-c431c44a-e691-498d-b108-2a5c5cb64a52 req-40f59c35-41a2-4849-8bf3-0f89d9ca1488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "name": "network-vif-plugged", "status": "completed", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:25.952685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-c431c44a-e691-498d-b108-2a5c5cb64a52 req-40f59c35-41a2-4849-8bf3-0f89d9ca1488 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:25.953163 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-c431c44a-e691-498d-b108-2a5c5cb64a52 req-40f59c35-41a2-4849-8bf3-0f89d9ca1488 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:25.965346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-c431c44a-e691-498d-b108-2a5c5cb64a52 req-40f59c35-41a2-4849-8bf3-0f89d9ca1488 service nova] Creating event network-vif-plugged:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:10:25.970390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-c431c44a-e691-498d-b108-2a5c5cb64a52 req-40f59c35-41a2-4849-8bf3-0f89d9ca1488 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029801 Jun 21 19:10:25.970984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 361/730] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:10:26.250831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:26.251445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:26.253673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:26.260262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:26.260712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:26.261544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:26.261981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:26.372959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:26.373682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:26.379844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:26.380285 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:26.381629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:26.382056 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:26.400375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:26.404237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:26.412888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:26.414409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:26.415514 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-782a78b2-0de7-4e28-a592-ba7f2c6fd8af tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.168805 Jun 21 19:10:26.416061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 370/731] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:26 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:26.516233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:26.523757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-64f8fe91-636c-4bd6-8e12-7c8972fca30b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.155391 Jun 21 19:10:26.524318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 362/732] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:26 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:27.433808 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:27.434409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:27.441928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:27.442374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:27.443157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:27.443595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:27.541004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:27.541658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:27.548477 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:27.548940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:27.549754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:27.550196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:27.704324 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:27.713408 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:27.714917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:27.716023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3c27102d-8106-481a-bbfa-d5b4c4d596a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1407 microversion: 2.20 time: 0.286306 Jun 21 19:10:27.716573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 371/733] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:27 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:27.765177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:27.773411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-17311335-bb61-49fa-935f-0e26e7e39c47 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.236338 Jun 21 19:10:27.773991 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 363/734] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:27 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:28.734138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:28.734752 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:28.741387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.741840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.742608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.743050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.790926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:28.791535 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:28.793420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:28.794101 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=8 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:28.800949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.801430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.802204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.802639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.916354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:28.924646 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:28.926152 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:28.927305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5459c68f-9a86-4dae-9f4c-9f1eed0e1e1d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1599 microversion: 2.20 time: 0.197100 Jun 21 19:10:28.928182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 372/735] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:10:28 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:10:28.944469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:28.944960 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:28.950897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.951425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.952203 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:28.952631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:28.963410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:28.969818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:28.971290 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d6817745-a71d-436f-bea0-30ebc766675b tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.184860 Jun 21 19:10:28.971884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 364/736] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:28 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:29.032809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-75462680-047d-45b3-916f-05f0bb479357 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092120 Jun 21 19:10:29.033436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 373/737] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jun 21 19:10:28 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 19:10:29.989579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:29.990236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:29.990881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-d8a5d80b-43b3-4fba-a8b7-218230c52e4c req-42427dc7-69e4-47f5-ab3a-d51538b57537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:29.997409 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:29.998172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:29.999001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:29.999255 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d8a5d80b-43b3-4fba-a8b7-218230c52e4c req-42427dc7-69e4-47f5-ab3a-d51538b57537 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:29.999704 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d8a5d80b-43b3-4fba-a8b7-218230c52e4c req-42427dc7-69e4-47f5-ab3a-d51538b57537 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:29.999912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:30.013533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-d8a5d80b-43b3-4fba-a8b7-218230c52e4c req-42427dc7-69e4-47f5-ab3a-d51538b57537 service nova] Creating event network-changed:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:10:30.018900 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-d8a5d80b-43b3-4fba-a8b7-218230c52e4c req-42427dc7-69e4-47f5-ab3a-d51538b57537 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031988 Jun 21 19:10:30.019750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 374/738] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:30.194320 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:30.202376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c23ba894-49be-443a-bc25-7d14ba60e316 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.216915 Jun 21 19:10:30.213212 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 365/739] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:29 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:31.221042 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:31.221778 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:31.228511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.228966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.229801 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.230239 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.602717 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:31.610236 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c18449cd-a452-4dc3-ac09-0578c0ae590c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1509 microversion: 2.1 time: 0.393961 Jun 21 19:10:31.610807 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 375/740] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:31 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:31.627606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:31.628179 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:31.635402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.635845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.636608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.637035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.729076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-87f57abc-98fb-4b89-bae9-c45712c69c3d tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "POST /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5/action" status: 202 len: 0 microversion: 2.1 time: 0.105384 Jun 21 19:10:31.729806 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 366/741] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:10:31 2022] POST /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:10:31.737821 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:31.738432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:31.745059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.745545 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.746313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:31.746740 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:31.932873 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:31.941195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4f96acaa-7653-43a1-8966-fbb2679e3bd2 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1517 microversion: 2.1 time: 0.207012 Jun 21 19:10:31.941992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 376/742] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:31 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:32.960869 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:32.961507 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:32.968379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:32.969839 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:32.970726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:32.971174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.108157 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:33.116663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ec07edf4-84a0-47da-9be6-fbc7592f4481 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.161325 Jun 21 19:10:33.117271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 367/743] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:32 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:33.167875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:33.168380 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:33.174938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:33.175390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.176159 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:33.176601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.261578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'services' on Instance uuid e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:10:33.340562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-11e9d893-9e38-4e75-836d-c0890c77d1dd tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments/ecea6540-a7e5-4085-99ca-a0abb83b65a1" status: 202 len: 0 microversion: 2.1 time: 0.176400 Jun 21 19:10:33.341144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 377/744] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:10:33 2022] DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments/ecea6540-a7e5-4085-99ca-a0abb83b65a1 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:10:33.349919 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:33.350978 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:33.358262 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:33.358707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.359487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:33.360144 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.392192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9e6e6355-b5f6-4de5-8e87-442c0d3ac08e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Jun 21 19:10:33.392831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 368/745] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:10:33 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:10:33.944881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c6bdcfb5-d195-469c-84e3-e5cb9514290c req-c93fae4a-740b-42fa-8627-1f127142d22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "name": "network-vif-unplugged", "status": "completed", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:33.954526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c6bdcfb5-d195-469c-84e3-e5cb9514290c req-c93fae4a-740b-42fa-8627-1f127142d22f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:33.954969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c6bdcfb5-d195-469c-84e3-e5cb9514290c req-c93fae4a-740b-42fa-8627-1f127142d22f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:33.970046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c6bdcfb5-d195-469c-84e3-e5cb9514290c req-c93fae4a-740b-42fa-8627-1f127142d22f service nova] Creating event network-vif-unplugged:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:10:33.976461 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c6bdcfb5-d195-469c-84e3-e5cb9514290c req-c93fae4a-740b-42fa-8627-1f127142d22f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037393 Jun 21 19:10:33.977359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 378/746] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:10:34.134301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:34.134912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:34.141644 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.142088 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.142849 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.143281 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.332433 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:34.340701 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c1c333ac-5682-4a84-b032-18a9509cb791 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.210259 Jun 21 19:10:34.341299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 369/747] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:34 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:34.404962 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:34.406016 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:34.414899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.415341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.416101 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.416532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.452606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b45b7db9-a4fb-46cd-a096-fcdd31bd0ed0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052295 Jun 21 19:10:34.453165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 379/748] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:10:34 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:10:34.528120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:34.528936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:34.535799 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.536593 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.538439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.538904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.566971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:10:34.646942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-36a00fe5-bb85-482f-90e1-a431aec38c9a tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 204 len: 0 microversion: 2.1 time: 0.123477 Jun 21 19:10:34.647863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 370/749] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:10:34 2022] DELETE /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:10:34.655759 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:34.656661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:34.662920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.663369 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.664131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:34.664564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:34.804457 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:34.812781 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-71097b05-00c9-4f88-b55f-de731a076003 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1690 microversion: 2.1 time: 0.160516 Jun 21 19:10:34.813415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 380/750] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:34 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:35.360040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:35.360722 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:35.368009 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:35.368454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:35.369259 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:35.369700 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:35.512263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:35.520235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e0214f04-e774-4043-9a18-d3df70d696ee tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.164358 Jun 21 19:10:35.520826 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 371/751] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:35 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:35.830825 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:35.831450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:35.837917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:35.838363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:35.839119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:35.839552 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:35.970444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:35.978519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ad3d5a52-e60e-4500-ace0-046cd388288e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1690 microversion: 2.1 time: 0.151500 Jun 21 19:10:35.979087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 381/752] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:35 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:36.540174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:36.540723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:36.547379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:36.547832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:36.548604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:36.549041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:36.682639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:36.690577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9a79218d-17d6-4e70-8068-1c0daf7b9db6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.154526 Jun 21 19:10:36.691142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 372/753] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:36 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:36.996349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:36.996969 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:37.004144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:37.004589 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:37.006199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:37.006644 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:37.151098 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:37.158826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8d13f24f-ec6e-4057-a24b-7b810616fafa tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1690 microversion: 2.1 time: 0.166393 Jun 21 19:10:37.159331 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 382/754] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:36 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:37.708052 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:37.709685 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:37.716544 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:37.716996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:37.717803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:37.718245 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:37.852972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:37.860702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5dd03272-e130-4cdd-9f2c-bdcbdf926bb0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.156593 Jun 21 19:10:37.861228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 373/755] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:37 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:38.175746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:38.176325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:38.182516 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:38.182964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:38.183730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:38.184165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:38.318489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:38.326705 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c376f341-2798-4165-8b17-02af20807b86 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1690 microversion: 2.1 time: 0.154819 Jun 21 19:10:38.327290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 383/756] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:38 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:38.877682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:38.878327 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:38.884887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:38.885377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:38.886712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:38.886712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:39.019329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:39.027120 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b9f1fe6c-587f-4ad7-8ecd-7ff890711325 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.153279 Jun 21 19:10:39.027690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 374/757] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:38 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:39.343797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:39.344669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:39.352561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:39.353124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:39.354039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:39.354482 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:39.581947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:39.589993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5a7cdd91-e976-45c4-8c38-f6c26b565fd9 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1690 microversion: 2.1 time: 0.250159 Jun 21 19:10:39.590564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 384/758] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:39 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:40.043651 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:40.044274 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:40.051054 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.051498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.052782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.053254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.204773 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-4cc02ffc-8310-413d-b802-3d5cdf919883 req-0f30d361-a591-4212-aa93-dee122e68bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aadfbd-a71b-448b-8184-8fb08a9a1ce9", "name": "network-vif-deleted", "tag": "6a8c9184-e12b-4020-9dd3-a5fab52e797e"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:40.225614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4cc02ffc-8310-413d-b802-3d5cdf919883 req-0f30d361-a591-4212-aa93-dee122e68bb3 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.226058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4cc02ffc-8310-413d-b802-3d5cdf919883 req-0f30d361-a591-4212-aa93-dee122e68bb3 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.251665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-4cc02ffc-8310-413d-b802-3d5cdf919883 req-0f30d361-a591-4212-aa93-dee122e68bb3 service nova] Creating event network-vif-deleted:6a8c9184-e12b-4020-9dd3-a5fab52e797e for instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 on hv-cinder-84630 Jun 21 19:10:40.251915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:40.260950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-4cc02ffc-8310-413d-b802-3d5cdf919883 req-0f30d361-a591-4212-aa93-dee122e68bb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060542 Jun 21 19:10:40.261812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 385/759] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:40.266458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4b5c01b4-86a1-4bfd-be4c-9869507aef2f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.225534 Jun 21 19:10:40.267979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 375/760] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:40 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:40.608225 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:40.609050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:40.610825 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:40.618168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.618624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.619399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.619831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.652053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:40.652394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:40.652839 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'fault' on Instance uuid e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:10:40.695637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:40.703087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-26e1d515-2d45-4b12-adb6-63766fcdbc88 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1336 microversion: 2.1 time: 0.099448 Jun 21 19:10:40.703998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 386/761] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:40 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:41.283751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:41.284344 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:41.288011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:41.294751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:41.295196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:41.295968 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:41.296395 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:41.316421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:41.444217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:41.451842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a9219aae-9e0b-46c9-b8ef-99b58d4e47da tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.171940 Jun 21 19:10:41.452412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 376/762] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:41 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:41.719847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:41.720398 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:41.727691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:41.728139 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:41.728917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:41.729405 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:41.761041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:41.761542 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:41.761977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lazy-loading 'fault' on Instance uuid e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:10:41.805591 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:41.813633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cb145167-1b70-48d0-86cc-e45fcb4a784f tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 200 len: 1336 microversion: 2.1 time: 0.097586 Jun 21 19:10:41.814494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 387/763] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:41 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:42.469029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:42.469665 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:42.476803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:42.477286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:42.478047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:42.478480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:42.617034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:42.624640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-026d710c-0113-4434-a40f-813b3dc55513 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.159374 Jun 21 19:10:42.625540 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 377/764] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:42 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:42.831082 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:42.831602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: e2aadfbd-a71b-448b-8184-8fb08a9a1ce9] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:42.838623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:42.839076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:42.839841 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:42.840285 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:42.853907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] HTTP exception thrown: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Request method failure captured: Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 HTTP/1.1 Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXfUWYtwzET13jYr4x56YwZuTLxo0CDv4HddLZc4o7eFmNzs1DxEKsJkkFVNRXCAy82jPr_KMvFBaBt63-ltRvZO7EorHFSRyGcA_wU0CcdnaPEZk1P_JVdSQIWJTV2-2GQHj_5MXCoWd_4qF7TOQ1jc-BTKFhSGapYk2B9Hk4i6kE Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:10:42.855760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}] Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: eeafe22d22f648d6aefcc6a308d4fc0d Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. Jun 21 19:10:42.857186 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'e2aadfbd-a71b-448b-8184-8fb08a9a1ce9'} Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:10:42.858001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. Jun 21 19:10:42.859269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:42.860667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Returning 404 to user: Instance e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:10:42.860667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9634456d-6944-459c-b97c-bd8a59f147d0 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9" status: 404 len: 111 microversion: 2.1 time: 0.030127 Jun 21 19:10:42.860667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 388/765] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:42 2022] GET /compute/v2.1/servers/e2aadfbd-a71b-448b-8184-8fb08a9a1ce9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:10:42.867452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3d811d95-33bd-437b-b6d5-55ad948b3b3e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '.version_select at 0x7f35957e5af0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:42.885048 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3d811d95-33bd-437b-b6d5-55ad948b3b3e tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313405296" status: 202 len: 0 microversion: 2.1 time: 0.021868 Jun 21 19:10:42.885652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 378/766] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 19:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313405296 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:10:43.642697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:43.643301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:43.649912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:43.650354 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:43.651102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:43.651531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:43.786797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:43.794484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e8c5b298-8c44-479c-8a02-44e92828e034 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1575 microversion: 2.1 time: 0.155559 Jun 21 19:10:43.795074 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 389/767] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:43 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:44.812171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:44.812750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:44.818929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:44.819426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:44.820267 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:44.820714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:44.962151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:44.970182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-102e3e60-e77a-4f9c-8ab0-a6fbc806869c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1562 microversion: 2.1 time: 0.162696 Jun 21 19:10:44.970677 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 379/768] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:44 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:10:45.771213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:45.771797 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:45.778918 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:45.779361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:45.780125 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:45.780555 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:45.805144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:10:45.838892 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:10:45.881445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2abe89ec-5aa7-4c49-8388-838124808f5d tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 204 len: 0 microversion: 2.1 time: 0.114324 Jun 21 19:10:45.882180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 390/769] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:10:45 2022] DELETE /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:10:45.890228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:45.890855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:45.897748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:45.898189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:45.899003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:45.899437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:46.028620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-73e5a6a5-c390-43b2-97f3-f4caea64a342 req-89633493-6247-41a7-9116-32c5c61152a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "name": "network-vif-plugged", "status": "completed", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:46.034145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:46.037417 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-73e5a6a5-c390-43b2-97f3-f4caea64a342 req-89633493-6247-41a7-9116-32c5c61152a9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:46.038074 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-73e5a6a5-c390-43b2-97f3-f4caea64a342 req-89633493-6247-41a7-9116-32c5c61152a9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:46.043206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6b63e003-7ba9-4656-8bd9-d1af73f09786 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1507 microversion: 2.1 time: 0.156879 Jun 21 19:10:46.043990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 380/770] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:45 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:46.055525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-73e5a6a5-c390-43b2-97f3-f4caea64a342 req-89633493-6247-41a7-9116-32c5c61152a9 service nova] Creating event network-vif-plugged:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:10:46.061312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-73e5a6a5-c390-43b2-97f3-f4caea64a342 req-89633493-6247-41a7-9116-32c5c61152a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Jun 21 19:10:46.062476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 391/771] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:47.061444 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:47.061990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:47.069526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:47.069974 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:47.070744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:47.071177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:47.173812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:47.191209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ef5a9210-de3b-4c35-946e-ee0e951fefe6 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 200 len: 1465 microversion: 2.1 time: 0.133203 Jun 21 19:10:47.193039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 381/772] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:47 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 1465 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:47.219953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-6a4ac2c2-677e-4294-b946-8ab988069c25 req-88f5a055-d063-4fcf-ac45-80c726631c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b", "name": "network-vif-deleted", "tag": "c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:47.230647 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6a4ac2c2-677e-4294-b946-8ab988069c25 req-88f5a055-d063-4fcf-ac45-80c726631c4c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:47.231085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6a4ac2c2-677e-4294-b946-8ab988069c25 req-88f5a055-d063-4fcf-ac45-80c726631c4c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:47.244025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-6a4ac2c2-677e-4294-b946-8ab988069c25 req-88f5a055-d063-4fcf-ac45-80c726631c4c service nova] Creating event network-vif-deleted:c53c04ef-0097-4a3c-b5d7-9a8f3627c5f7 for instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b on hv-cinder-84630 Jun 21 19:10:47.249851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-6a4ac2c2-677e-4294-b946-8ab988069c25 req-88f5a055-d063-4fcf-ac45-80c726631c4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Jun 21 19:10:47.250856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 392/773] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:48.209963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:48.210579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:48.217766 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.218222 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.219001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.219436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.233386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] HTTP exception thrown: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Request method failure captured: Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b HTTP/1.1 Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXfUWYtwzET13jYr4x56YwZuTLxo0CDv4HddLZc4o7eFmNzs1DxEKsJkkFVNRXCAy82jPr_KMvFBaBt63-ltRvZO7EorHFSRyGcA_wU0CcdnaPEZk1P_JVdSQIWJTV2-2GQHj_5MXCoWd_4qF7TOQ1jc-BTKFhSGapYk2B9Hk4i6kE Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:10:48.235033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}] Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: eeafe22d22f648d6aefcc6a308d4fc0d Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. Jun 21 19:10:48.236635 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b'} Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:10:48.237771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. Jun 21 19:10:48.239254 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:10:48.240724 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Returning 404 to user: Instance da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:10:48.240724 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-17da803b-24d1-4f15-bbce-aaa50ee820ad tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b" status: 404 len: 111 microversion: 2.1 time: 0.030806 Jun 21 19:10:48.240724 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 382/774] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:48 2022] GET /compute/v2.1/servers/da67f50b-17f8-4f4d-88c3-cd6a3ac20a1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:10:48.245812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:48.246393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:48.252475 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.252923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.253714 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.254150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.279063 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:10:48.359862 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b75f5bb-36f6-458b-9be8-fea3ab8da46b tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 204 len: 0 microversion: 2.1 time: 0.118239 Jun 21 19:10:48.360475 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 393/775] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:10:48 2022] DELETE /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 19:10:48.368844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:48.369529 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:48.375610 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.376063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.376834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:48.377300 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:48.509631 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:48.517473 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-08a046f2-c929-4e3f-923c-f60ba2e485c4 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.152675 Jun 21 19:10:48.518052 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 383/776] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:48 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:49.536557 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:49.538039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:49.561046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:49.561547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:49.562352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:49.562786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:49.820760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeafe22d22f648d6aefcc6a308d4fc0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1af5239143346e8b995f4176d78ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:10:49.832453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6d1c4238-1c96-46c3-9c0a-cd3a3e10b0f5 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 200 len: 1521 microversion: 2.1 time: 0.300258 Jun 21 19:10:49.834180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 394/777] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:49 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:10:49.916379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-845883ad-728a-4ec1-b82b-4964833167bf req-b576bbfb-06c6-45f2-973f-2f646388527f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a342ffaa-5a3b-44f2-8bd6-309d7768b588", "name": "network-vif-deleted", "tag": "dec56129-7c7f-479b-a8a4-27f8c5ef76c0"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:49.927495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-845883ad-728a-4ec1-b82b-4964833167bf req-b576bbfb-06c6-45f2-973f-2f646388527f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:49.927946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-845883ad-728a-4ec1-b82b-4964833167bf req-b576bbfb-06c6-45f2-973f-2f646388527f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:49.940269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-845883ad-728a-4ec1-b82b-4964833167bf req-b576bbfb-06c6-45f2-973f-2f646388527f service nova] Creating event network-vif-deleted:dec56129-7c7f-479b-a8a4-27f8c5ef76c0 for instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 on hv-cinder-84630 Jun 21 19:10:49.945707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-845883ad-728a-4ec1-b82b-4964833167bf req-b576bbfb-06c6-45f2-973f-2f646388527f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Jun 21 19:10:49.946319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 384/778] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:10:50.850347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:10:50.850901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] [instance: a342ffaa-5a3b-44f2-8bd6-309d7768b588] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:10:50.857418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:50.857868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:50.858632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:10:50.859064 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:10:50.872352 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] HTTP exception thrown: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Request method failure captured: Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 HTTP/1.1 Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXfUWYtwzET13jYr4x56YwZuTLxo0CDv4HddLZc4o7eFmNzs1DxEKsJkkFVNRXCAy82jPr_KMvFBaBt63-ltRvZO7EorHFSRyGcA_wU0CcdnaPEZk1P_JVdSQIWJTV2-2GQHj_5MXCoWd_4qF7TOQ1jc-BTKFhSGapYk2B9Hk4i6kE Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:10:50.874021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f1af5239143346e8b995f4176d78ca4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f1af5239143346e8b995f4176d78ca4d"}]}] Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: f1af5239143346e8b995f4176d78ca4d Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-101266550 Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: eeafe22d22f648d6aefcc6a308d4fc0d Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-ServerRescueNegativeTestJSON-101266550-project Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. Jun 21 19:10:50.875554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'a342ffaa-5a3b-44f2-8bd6-309d7768b588'} Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:10:50.876491 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. Jun 21 19:10:50.878022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:10:50.879419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] Returning 404 to user: Instance a342ffaa-5a3b-44f2-8bd6-309d7768b588 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:10:50.879419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-753ff164-9668-47c5-9b41-05ed7ebb7854 tempest-ServerRescueNegativeTestJSON-101266550 tempest-ServerRescueNegativeTestJSON-101266550-project] 10.222.0.70 "GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588" status: 404 len: 111 microversion: 2.1 time: 0.029139 Jun 21 19:10:50.879419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 395/779] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:10:50 2022] GET /compute/v2.1/servers/a342ffaa-5a3b-44f2-8bd6-309d7768b588 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 19:10:59.800272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-11d40b84-f6e6-467a-9377-b6d970c84802 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: .version_select at 0x7f35959a9280>, body: {"keypair": {"name": "tempest-keypair-541332911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW+ZiEbZ9XR3Q+BI9XPplImf3He5GJobhx5jTGCBPHvei232GQL8bSSSc4J2J3uNvHGAvQNLJXX5nkMmK6TEd79w+GfN42/lFJsVdkSFBJpWCQ310DbU/tY2mDJ6MUxBQ=="}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:10:59.815897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-11d40b84-f6e6-467a-9377-b6d970c84802 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:10:59.820420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-11d40b84-f6e6-467a-9377-b6d970c84802 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:10:59.843778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-11d40b84-f6e6-467a-9377-b6d970c84802 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168054 Jun 21 19:10:59.844577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 385/780] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:10:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:11:00.202857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:00.203828 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:00.212174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.212623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.213582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.214025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.247283 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-64aeeacb-d845-4de3-aa9a-38f76ec82121 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048571 Jun 21 19:11:00.247860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 396/781] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:11:00 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 19:11:00.317723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:00.318347 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:00.320768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=36 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:00.326646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.327286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.328234 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.328948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.359095 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:11:00.442990 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-56723201-628e-4bfa-a1c3-a67d7b0e3130 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 204 len: 0 microversion: 2.1 time: 0.129158 Jun 21 19:11:00.443989 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 386/782] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:11:00 2022] DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:11:00.453786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:00.455062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:00.462648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.463524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.464525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:00.464965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:00.679726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:00.687562 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b0710b57-c0dd-4308-9e25-9fe8f5c5bb83 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1672 microversion: 2.1 time: 0.238521 Jun 21 19:11:00.688142 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 397/783] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:00 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:01.239209 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1936194980", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e9591ce-30ff-4920-8896-3d382a8c79e7"}], "security_groups": [{"name": "tempest-securitygroup--1531363883"}], "key_name": "tempest-keypair-541332911", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:01.359167 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] validate_networks() for [('8e9591ce-30ff-4920-8896-3d382a8c79e7', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:11:01.706236 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:01.708117 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:01.723644 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:01.724416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:01.725645 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:01.726317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:01.884925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:11:01.886102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:11:01.886897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:11:01.887649 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:11:01.888390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:11:01.906385 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:01.907195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:01.908412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:01.909284 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:01.944663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:11:01.950143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:11:01.978704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:11:01.985486 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:11:02.057428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:02.069308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1c12a8c3-2039-4b98-a745-75c872eb26dd tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1672 microversion: 2.1 time: 0.367211 Jun 21 19:11:02.069716 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-62cfde70-3cfe-4a77-8c0a-18ad24fb1ef4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.835781 Jun 21 19:11:02.070941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 387/784] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:11:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:11:02.074215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 398/785] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:01 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1672 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:02.082160 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3f4b43a1-af97-4667-85d1-0d88176d718d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:02.084356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3f4b43a1-af97-4667-85d1-0d88176d718d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:02.177263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3f4b43a1-af97-4667-85d1-0d88176d718d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:02.185680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3f4b43a1-af97-4667-85d1-0d88176d718d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1241 microversion: 2.1 time: 0.108672 Jun 21 19:11:02.187468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 388/786] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:02 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:03.068965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-4f720683-aa08-48a1-8a45-191e456a8c3f req-471b68d9-6bcb-4d0f-b440-a4ec7030d1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c71b4bb-1be3-4662-aa0b-78d6acfa27ff", "name": "network-vif-deleted", "tag": "ec0ef0ca-8788-4f95-bf71-f3ce17595dce"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:03.086838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4f720683-aa08-48a1-8a45-191e456a8c3f req-471b68d9-6bcb-4d0f-b440-a4ec7030d1ca service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:03.087624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-4f720683-aa08-48a1-8a45-191e456a8c3f req-471b68d9-6bcb-4d0f-b440-a4ec7030d1ca service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:03.091710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:03.093302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:03.105316 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:03.106032 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:03.107018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:03.107624 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:03.115020 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-4f720683-aa08-48a1-8a45-191e456a8c3f req-471b68d9-6bcb-4d0f-b440-a4ec7030d1ca service nova] Creating event network-vif-deleted:ec0ef0ca-8788-4f95-bf71-f3ce17595dce for instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff on hv-cinder-84630 Jun 21 19:11:03.125019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-4f720683-aa08-48a1-8a45-191e456a8c3f req-471b68d9-6bcb-4d0f-b440-a4ec7030d1ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063656 Jun 21 19:11:03.131160 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 399/787] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:03.204740 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:03.205675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:03.222393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:03.222641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:03.226001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:03.227206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:03.227817 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:03.244525 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9b66bff5-a5c5-4d11-982b-e22ed5ccac81 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 200 len: 1605 microversion: 2.1 time: 0.153234 Jun 21 19:11:03.245472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 389/788] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:03 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:03.349360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:03.359314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-268c79c4-018f-4169-b310-39cef2fc800a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1293 microversion: 2.1 time: 0.159264 Jun 21 19:11:03.359921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 400/789] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:03 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:04.262952 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:04.263680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:04.271238 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:04.271848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:04.272745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:04.273362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:04.291369 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff HTTP/1.1 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:11:04.293720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:11:04.295086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '9c71b4bb-1be3-4662-aa0b-78d6acfa27ff'} Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:11:04.295878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:11:04.297074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:11:04.298518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:11:04.298518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cfc5584b-e7dc-46d4-ae73-d4a1339b7588 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 404 len: 111 microversion: 2.1 time: 0.036392 Jun 21 19:11:04.298518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 390/790] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:04 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:11:04.304240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-81ecb305-b411-4d15-a5f3-e09dce7d3611 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '.version_select at 0x7f359a12a8b0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:04.326942 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-81ecb305-b411-4d15-a5f3-e09dce7d3611 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80664351" status: 202 len: 0 microversion: 2.1 time: 0.026353 Jun 21 19:11:04.328122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 401/791] 10.222.0.70 () {58 vars in 1214 bytes} [Tue Jun 21 19:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80664351 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:11:04.377361 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:04.380082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:04.390182 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:04.390913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:04.392282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:04.392927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:04.524648 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:04.549249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72430811-75ff-4bc6-9dfe-f394022236db tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1299 microversion: 2.1 time: 0.174276 Jun 21 19:11:04.550195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 391/792] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:04 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:05.026260 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c899248a-5bee-4bba-8813-dff3432d4263 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: .version_select at 0x7f359578b550>, body: {"keypair": {"name": "tempest-keypair-1522036316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhijuoWropH238SDObr6CTuejxvhSwtw5L90pftCh8HfBpVTxpEFM86jrMus9GBqTenlIbUV9eRJk94nRm8z+Pz77UL/XjAmn6NS6cojyC7ksfnCzUdTS6Ol4mdzRRRIA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:05.043495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-c899248a-5bee-4bba-8813-dff3432d4263 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:11:05.047520 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-c899248a-5bee-4bba-8813-dff3432d4263 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for user 2b973f8f63eb49f19895a43313f2bc55 and project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:11:05.071674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c899248a-5bee-4bba-8813-dff3432d4263 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049340 Jun 21 19:11:05.072566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 402/793] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:11:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:11:05.567810 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:05.569314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:05.577811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:05.578584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:05.579755 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:05.580346 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:05.683398 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-9fa00c6b-5a82-47c4-8327-1966fc99ed27 req-3c9a25f0-6c8b-456a-bd54-ef35dcdc1088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45ca17-da52-48bf-9d33-860f2652bd91", "tag": "04a64e0b-7e64-4082-a247-ef55ea2f3052"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:05.701802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-9fa00c6b-5a82-47c4-8327-1966fc99ed27 req-3c9a25f0-6c8b-456a-bd54-ef35dcdc1088 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:05.702256 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-9fa00c6b-5a82-47c4-8327-1966fc99ed27 req-3c9a25f0-6c8b-456a-bd54-ef35dcdc1088 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:05.714651 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-9fa00c6b-5a82-47c4-8327-1966fc99ed27 req-3c9a25f0-6c8b-456a-bd54-ef35dcdc1088 service nova] Creating event network-changed:04a64e0b-7e64-4082-a247-ef55ea2f3052 for instance 1a45ca17-da52-48bf-9d33-860f2652bd91 on hv-cinder-84630 Jun 21 19:11:05.720073 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-9fa00c6b-5a82-47c4-8327-1966fc99ed27 req-3c9a25f0-6c8b-456a-bd54-ef35dcdc1088 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040886 Jun 21 19:11:05.721507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 403/794] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:11:05.925973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:05.934537 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fd9f2a90-9529-496f-824a-8784b709f93b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.371683 Jun 21 19:11:05.935125 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 392/795] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:05 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:06.423792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1131119063", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28dfca6-c8cd-489e-b796-006f3a518cdc"}], "security_groups": [{"name": "tempest-securitygroup--1724895925"}], "key_name": "tempest-keypair-1522036316", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:06.525310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] validate_networks() for [('c28dfca6-c8cd-489e-b796-006f3a518cdc', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:11:06.951968 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:06.953333 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:06.959526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:11:06.960290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:11:06.960489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:11:06.960857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:11:06.961321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:11:06.962352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:06.962811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:06.963603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:06.964076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:06.971312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:06.971771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:06.972606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:06.973639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:06.992897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:11:06.997923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Getting quotas for user 2b973f8f63eb49f19895a43313f2bc55 and project b6bbb7a5373e46f69acab406d82d87f3. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:11:07.012044 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:11:07.014673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:11:07.067806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2a5015a6-2575-418d-9f6b-ccedce2de785 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648638 Jun 21 19:11:07.069176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 404/796] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:11:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:11:07.079754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-883ea776-66d2-40e5-95ea-b920ca84995d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:07.080734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-883ea776-66d2-40e5-95ea-b920ca84995d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:07.137267 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:07.147240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9b7ad34a-d2b6-49a5-ab4b-fcec730798e6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.199215 Jun 21 19:11:07.148566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 393/797] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:06 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:07.154371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-883ea776-66d2-40e5-95ea-b920ca84995d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:07.162452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-883ea776-66d2-40e5-95ea-b920ca84995d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1238 microversion: 2.1 time: 0.086968 Jun 21 19:11:07.163556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 405/798] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:07 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:08.173152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:08.174403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:08.181824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:08.182282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:08.182515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:08.183059 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:08.183165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:08.183502 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:08.190567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:08.191008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:08.191847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:08.192277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:08.277377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:08.284966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6f6ed48d-4afa-4fff-b9e5-bbefa47e8e9f tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1242 microversion: 2.1 time: 0.106641 Jun 21 19:11:08.286094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 406/799] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:08 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:08.353075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:08.361145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3a37c56f-b9b7-426a-a6b0-f3ca7836d501 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.191804 Jun 21 19:11:08.361730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 394/800] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:08 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:09.304155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:09.304972 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:09.312363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:09.312897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:09.314154 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:09.314680 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:09.378760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:09.379959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:09.390589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:09.391380 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:09.392170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:09.392611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:09.451042 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:09.460665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da72e94c-f20e-4c18-a8cb-16f2da295736 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1298 microversion: 2.1 time: 0.161280 Jun 21 19:11:09.465776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 407/801] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:09 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:09.655856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:09.664390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c9bbb890-520d-4918-8df4-0e9d8cfe4745 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.289579 Jun 21 19:11:09.673959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 395/802] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:09 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:10.480222 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:10.481665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:10.488409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:10.489034 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:10.490105 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:10.490546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:10.681966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:10.682856 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:10.689556 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:10.689993 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:10.690754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:10.691220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:10.726666 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:10.734534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-77175005-ad55-4b8b-85f5-bfa6730fce33 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.260056 Jun 21 19:11:10.735183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 408/803] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:10 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:10.895243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:10.903878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2eed9208-1be8-4f48-b74d-c242dbb48dab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.225583 Jun 21 19:11:10.904462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 396/804] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:10 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:11:11.186457 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-6dcb24c5-1da7-4d00-8721-84eea013993a req-58bb03ec-d866-4a0d-b548-496cc59ff86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1c09fb-5000-49a4-9038-a436e59ca472", "tag": "7354e441-3d70-4860-8b52-b478e465d4e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:11.190413 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:11.198637 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6dcb24c5-1da7-4d00-8721-84eea013993a req-58bb03ec-d866-4a0d-b548-496cc59ff86c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:11.199147 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-6dcb24c5-1da7-4d00-8721-84eea013993a req-58bb03ec-d866-4a0d-b548-496cc59ff86c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:11.211887 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-6dcb24c5-1da7-4d00-8721-84eea013993a req-58bb03ec-d866-4a0d-b548-496cc59ff86c service nova] Creating event network-changed:7354e441-3d70-4860-8b52-b478e465d4e1 for instance 5e1c09fb-5000-49a4-9038-a436e59ca472 on hv-cinder-84630 Jun 21 19:11:11.220227 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-6dcb24c5-1da7-4d00-8721-84eea013993a req-58bb03ec-d866-4a0d-b548-496cc59ff86c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037912 Jun 21 19:11:11.223181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 409/805] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:11.754709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:11.755323 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:11.757828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:11.763403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:11.763858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:11.764710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:11.765178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:11.905957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:11.913379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8098eeeb-7239-480b-a13e-b757120167bc tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.163127 Jun 21 19:11:11.913948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 397/806] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:11 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:11.922032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:11.922731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:11.930906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:11.931351 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:11.932114 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:11.932544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:12.072731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:12.080745 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9881f718-ad80-417d-8c6c-fb13bc398c4d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.163522 Jun 21 19:11:12.081381 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 410/807] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:11 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:12.219160 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-55160082-d415-4188-a632-968f5323b998 req-c23ceece-39d7-418e-9fa9-5291471bc453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45ca17-da52-48bf-9d33-860f2652bd91", "name": "network-vif-plugged", "status": "completed", "tag": "04a64e0b-7e64-4082-a247-ef55ea2f3052"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:12.224031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:12.224730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=12 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:12.229147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-55160082-d415-4188-a632-968f5323b998 req-c23ceece-39d7-418e-9fa9-5291471bc453 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:12.229593 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-55160082-d415-4188-a632-968f5323b998 req-c23ceece-39d7-418e-9fa9-5291471bc453 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:12.242657 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-55160082-d415-4188-a632-968f5323b998 req-c23ceece-39d7-418e-9fa9-5291471bc453 service nova] Creating event network-vif-plugged:04a64e0b-7e64-4082-a247-ef55ea2f3052 for instance 1a45ca17-da52-48bf-9d33-860f2652bd91 on hv-cinder-84630 Jun 21 19:11:12.247778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-55160082-d415-4188-a632-968f5323b998 req-c23ceece-39d7-418e-9fa9-5291471bc453 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032692 Jun 21 19:11:12.248381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 398/808] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:12.931977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:12.932593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:12.939315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:12.939763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:12.940532 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:12.940978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:13.073451 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:13.081379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-07df0795-1503-4afd-bec0-0159cef31b5a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.153167 Jun 21 19:11:13.081997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 411/809] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:12 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:13.099705 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:13.100409 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:13.106787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:13.107231 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:13.107999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:13.108437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:13.241747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:13.249279 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e2bf104e-a591-41aa-b7a0-3efe3094e8b3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.154356 Jun 21 19:11:13.249852 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 399/810] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:13 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:14.098788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:14.099441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:14.105601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:14.106048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:14.106809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:14.107242 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:14.239931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:14.243390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:14.248344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cf22db70-00a6-43c6-96b4-bec53bf5eb11 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.153419 Jun 21 19:11:14.248909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 412/811] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:14 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:14.265850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:14.266466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:14.274395 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:14.274598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:14.275344 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:14.275781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:14.528804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:14.536303 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-52efb31a-c685-4243-a68f-8c829c28a865 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.274206 Jun 21 19:11:14.536868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 400/812] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:14 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:15.266625 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:15.267267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:15.274726 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:15.275185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:15.276153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:15.276595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:15.463677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:15.471053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-506ed2ef-c539-4e09-8aed-48fcc9f99931 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.208639 Jun 21 19:11:15.471595 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 413/813] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:15 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:15.552847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:15.553484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:15.559994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:15.560436 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:15.561225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:15.561658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:15.690340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:15.698595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-892e96e4-eae6-4546-bea2-81d778b128f1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1367 microversion: 2.1 time: 0.149413 Jun 21 19:11:15.699166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 401/814] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:15 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:16.487650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:16.488812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:16.495249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.495690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.496438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.496864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.629494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:16.636847 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fe471f62-a481-4fe5-9841-3b2e78815325 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.152995 Jun 21 19:11:16.637436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 414/815] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:16 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:16.715639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:16.716243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:16.723551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.724003 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.724775 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.725251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.858375 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:16.865872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ec63277d-4eed-4cd6-a8ce-e99fcc7ec648 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1556 microversion: 2.1 time: 0.154037 Jun 21 19:11:16.866435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 402/816] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:16 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:16.882128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:16.882655 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:16.888639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.889096 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.889887 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:16.890326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:16.970760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-84b2da5d-95fd-4393-8133-f9911bd614f0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088943 Jun 21 19:11:16.970760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 415/817] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:11:16 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:17.654602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:17.655247 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:17.661305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:17.661756 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:17.662521 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:17.662961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:17.842458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:17.846005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:17.851652 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a0a350a4-264a-48fc-907b-6001dfe893f7 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.200916 Jun 21 19:11:17.852236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 403/818] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:17 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:17.984871 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:17.985713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:17.991205 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-e59c5ec1-37ce-49e0-b1ce-46d7fc46a5c5 req-38f7ee3c-d33d-40b1-b190-9cf706ff2038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45ca17-da52-48bf-9d33-860f2652bd91", "tag": "04a64e0b-7e64-4082-a247-ef55ea2f3052"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:18.000165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e59c5ec1-37ce-49e0-b1ce-46d7fc46a5c5 req-38f7ee3c-d33d-40b1-b190-9cf706ff2038 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:18.000616 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-e59c5ec1-37ce-49e0-b1ce-46d7fc46a5c5 req-38f7ee3c-d33d-40b1-b190-9cf706ff2038 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:18.012026 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-e59c5ec1-37ce-49e0-b1ce-46d7fc46a5c5 req-38f7ee3c-d33d-40b1-b190-9cf706ff2038 service nova] Creating event network-changed:04a64e0b-7e64-4082-a247-ef55ea2f3052 for instance 1a45ca17-da52-48bf-9d33-860f2652bd91 on hv-cinder-84630 Jun 21 19:11:18.016954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-e59c5ec1-37ce-49e0-b1ce-46d7fc46a5c5 req-38f7ee3c-d33d-40b1-b190-9cf706ff2038 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032593 Jun 21 19:11:18.017867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 416/819] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:18.293587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-2c8f351d-e08c-4e3f-9a1b-cf80da7b27a8 req-82d0d409-5862-43f6-a989-a55e2fbd1d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1c09fb-5000-49a4-9038-a436e59ca472", "name": "network-vif-plugged", "status": "completed", "tag": "7354e441-3d70-4860-8b52-b478e465d4e1"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:18.311204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2c8f351d-e08c-4e3f-9a1b-cf80da7b27a8 req-82d0d409-5862-43f6-a989-a55e2fbd1d83 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:18.311996 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2c8f351d-e08c-4e3f-9a1b-cf80da7b27a8 req-82d0d409-5862-43f6-a989-a55e2fbd1d83 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:18.337804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-2c8f351d-e08c-4e3f-9a1b-cf80da7b27a8 req-82d0d409-5862-43f6-a989-a55e2fbd1d83 service nova] Creating event network-vif-plugged:7354e441-3d70-4860-8b52-b478e465d4e1 for instance 5e1c09fb-5000-49a4-9038-a436e59ca472 on hv-cinder-84630 Jun 21 19:11:18.346845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-2c8f351d-e08c-4e3f-9a1b-cf80da7b27a8 req-82d0d409-5862-43f6-a989-a55e2fbd1d83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059836 Jun 21 19:11:18.348517 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 404/820] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:18.869123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:18.870085 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:18.877243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:18.877894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:18.878715 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:18.879161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:19.021226 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:19.028795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6dd6dc88-c000-48c4-8486-a7b7c1a2a2ae tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.163846 Jun 21 19:11:19.029407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 417/821] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:18 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:20.047532 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:20.048266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:20.055185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:20.055639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:20.056403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:20.056843 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:20.191798 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:20.199261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0def1a4c-cb1d-435b-b1e0-dc2cec74d99a tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1364 microversion: 2.1 time: 0.156497 Jun 21 19:11:20.199830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 405/822] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:20 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:21.216111 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:21.216750 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:21.223459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:21.223905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:21.224662 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:21.225106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:21.354519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:21.361884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-98b9e805-7746-42f4-b30f-965947f74bf3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1551 microversion: 2.1 time: 0.149625 Jun 21 19:11:21.362438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 418/823] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:21 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:21.379933 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:21.380822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:21.387691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:21.388075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:21.388853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:21.389359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:21.465097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-03819a7f-4650-4a91-9a17-0be4c067f244 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089926 Jun 21 19:11:21.465703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 406/824] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:11:21 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:22.626311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-189d0c87-9d00-4148-b3ba-40d4f1cab89f req-0d7e9c2d-9569-4c51-8598-51e8ebeaa1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1c09fb-5000-49a4-9038-a436e59ca472", "tag": "7354e441-3d70-4860-8b52-b478e465d4e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:22.634931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-189d0c87-9d00-4148-b3ba-40d4f1cab89f req-0d7e9c2d-9569-4c51-8598-51e8ebeaa1d7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:22.635371 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-189d0c87-9d00-4148-b3ba-40d4f1cab89f req-0d7e9c2d-9569-4c51-8598-51e8ebeaa1d7 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:22.646168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-189d0c87-9d00-4148-b3ba-40d4f1cab89f req-0d7e9c2d-9569-4c51-8598-51e8ebeaa1d7 service nova] Creating event network-changed:7354e441-3d70-4860-8b52-b478e465d4e1 for instance 5e1c09fb-5000-49a4-9038-a436e59ca472 on hv-cinder-84630 Jun 21 19:11:22.650990 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-189d0c87-9d00-4148-b3ba-40d4f1cab89f req-0d7e9c2d-9569-4c51-8598-51e8ebeaa1d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028302 Jun 21 19:11:22.651731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 419/825] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:11:49.759825 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=19 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:49.760661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=12 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:49.765321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1930238270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006781389", "security_groups": [{"name": "tempest-secgroup-smoke-1224501279"}], "block_device_mapping_v2": [{"uuid": "77b357ca-17ee-40eb-85ac-15ec34d5486d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f86cc32-39a0-4e38-9448-e17d5262fa8d"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:49.882331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] validate_networks() for [('2f86cc32-39a0-4e38-9448-e17d5262fa8d', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:11:50.264875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:11:50.265447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:11:50.265929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:11:50.266341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:11:50.266757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:11:50.275766 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:50.276012 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:50.276921 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:50.277291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:50.295012 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:11:50.299239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Getting quotas for user 569256e6d1d1418eafb5ff2ed8909926 and project cccd9a91f96a4a698f5d9d7028216a35. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:11:50.358501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:11:50.360570 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77b357ca-17ee-40eb-85ac-15ec34d5486d',volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:11:50.491925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-99b523cf-ab5c-433b-9877-5d4c10e18b5a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733614 Jun 21 19:11:50.492583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 407/826] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:11:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:11:50.500826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=21 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:50.501738 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=32 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:11:50.506436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2b4f007a-d3e4-44a5-a06a-3fdfc532913c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:50.507290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2b4f007a-d3e4-44a5-a06a-3fdfc532913c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:50.564436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b4f007a-d3e4-44a5-a06a-3fdfc532913c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:50.570975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2b4f007a-d3e4-44a5-a06a-3fdfc532913c tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1095 microversion: 2.1 time: 0.071840 Jun 21 19:11:50.571531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 420/827] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:50 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:51.588448 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:51.589075 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:51.596893 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:51.597382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:51.598194 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:51.598660 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:51.686632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:51.694376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e0f6c3b9-746a-4cbf-a0fd-da9fbbe13fbf tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1211 microversion: 2.1 time: 0.110249 Jun 21 19:11:51.694957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 408/828] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:51 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:52.712523 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:52.713256 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:52.720127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:52.720702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:52.721884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:52.722420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:52.908655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-4cc90e0a-6260-497a-8011-94f1f834b278 req-4cd9a185-8490-40e9-95e3-1687a0e5e932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675894b3-7569-4b40-9ab8-f43a4d9d5450", "tag": "1662bf13-bcce-4c24-bb2c-c08c77cc2065"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:11:52.925583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4cc90e0a-6260-497a-8011-94f1f834b278 req-4cd9a185-8490-40e9-95e3-1687a0e5e932 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:52.926028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-4cc90e0a-6260-497a-8011-94f1f834b278 req-4cd9a185-8490-40e9-95e3-1687a0e5e932 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:52.940692 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-4cc90e0a-6260-497a-8011-94f1f834b278 req-4cd9a185-8490-40e9-95e3-1687a0e5e932 service nova] Creating event network-changed:1662bf13-bcce-4c24-bb2c-c08c77cc2065 for instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 on hv-cinder-84630 Jun 21 19:11:52.947014 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-4cc90e0a-6260-497a-8011-94f1f834b278 req-4cd9a185-8490-40e9-95e3-1687a0e5e932 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045453 Jun 21 19:11:52.947732 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:52.948304 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 409/829] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:11:52.956741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-515c98da-67e0-4802-bd0f-0256a719ecd4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.248880 Jun 21 19:11:52.957399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 421/830] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:52 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:53.975687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:53.976400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:53.982650 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:53.983095 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:53.983865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:53.984302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:54.116220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:54.123730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-285f31c9-df73-43d6-82be-4746233f9cf9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.152678 Jun 21 19:11:54.124304 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 410/831] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:53 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:55.140529 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:55.141182 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:55.148349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:55.148799 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:55.149678 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:55.150724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:55.282985 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:55.290497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-685a0686-cb68-4a32-8735-07e926a415fd tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.153857 Jun 21 19:11:55.291058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 422/832] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:55 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:56.307239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:56.307860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:56.314121 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:56.314844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:56.315620 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:56.316061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:56.454417 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:56.462428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ad7b5cc4-85e0-45b8-a666-e602dc27b462 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.159056 Jun 21 19:11:56.462988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 411/833] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:56 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:57.479081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:57.479700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:57.486278 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:57.487312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:57.488095 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:57.488647 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:57.620625 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:57.629301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3c4ad1bb-2aee-4c16-9aea-23c5f36828d1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.154022 Jun 21 19:11:57.629998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 423/834] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:57 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:58.647189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:58.647743 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:58.654241 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:58.654695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:58.655454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:58.655903 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:58.790861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:58.798488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-567ad02f-b122-4b6b-8c0b-7cc20b3efc90 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.155946 Jun 21 19:11:58.799060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 412/835] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:58 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:11:59.815954 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:11:59.816575 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:11:59.823500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:59.823938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:59.824712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:11:59.825174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:11:59.955170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:11:59.963221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-226a6e66-00cd-46d4-b709-e2ab1a338ef8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.151469 Jun 21 19:11:59.963783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 424/836] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:11:59 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:00.980619 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:00.981272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:00.983917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:00.984637 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:00.991477 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:00.991920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:00.992694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:00.993155 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:01.123259 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:01.130829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4ceb86fc-1f6c-4dfd-abc4-5438623ec3a7 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.154102 Jun 21 19:12:01.131397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 413/837] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:00 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:02.147613 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:02.148162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:02.150041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:02.155702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:02.156155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:02.156922 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:02.157399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:02.293717 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:02.301594 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df07f945-c030-48f4-b1ad-991d9e2458ba tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.157894 Jun 21 19:12:02.302151 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 425/838] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:02 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:03.318270 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:03.318865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:03.326490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:03.326936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:03.327710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:03.328135 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:03.461821 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:03.469753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a4e12849-f0ed-471c-85b9-0e2f0ffa9a23 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.155967 Jun 21 19:12:03.470342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 414/839] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:03 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:04.335244 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-ec073441-7648-4c3e-a505-ebff91ea1257 req-9edacba8-6cf3-4a99-9535-6362ab2162ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675894b3-7569-4b40-9ab8-f43a4d9d5450", "name": "network-vif-plugged", "status": "completed", "tag": "1662bf13-bcce-4c24-bb2c-c08c77cc2065"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:04.343524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ec073441-7648-4c3e-a505-ebff91ea1257 req-9edacba8-6cf3-4a99-9535-6362ab2162ac service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:04.343960 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ec073441-7648-4c3e-a505-ebff91ea1257 req-9edacba8-6cf3-4a99-9535-6362ab2162ac service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:04.486956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:04.487591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:04.494219 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:04.494662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:04.495456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:04.495889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:04.503000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-ec073441-7648-4c3e-a505-ebff91ea1257 req-9edacba8-6cf3-4a99-9535-6362ab2162ac service nova] Creating event network-vif-plugged:1662bf13-bcce-4c24-bb2c-c08c77cc2065 for instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 on hv-cinder-84630 Jun 21 19:12:04.508147 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-ec073441-7648-4c3e-a505-ebff91ea1257 req-9edacba8-6cf3-4a99-9535-6362ab2162ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176584 Jun 21 19:12:04.508848 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 426/840] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:12:04.644484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:04.652322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d95d1f26-5d8b-4f0c-9abe-55ad54396123 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.169243 Jun 21 19:12:04.652904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 415/841] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:04 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:12:05.670697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:05.671308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:05.678227 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:05.678677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:05.679445 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:05.679881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:05.815804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:05.823269 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2b855687-1266-4461-85c9-5906428cd7fe tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.157344 Jun 21 19:12:05.823816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 427/842] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:05 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:06.840258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:06.840866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:06.847712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:06.848164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:06.848934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:06.849412 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:06.985054 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:06.993340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8c895663-0176-46a3-b420-9514511face8 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1267 microversion: 2.1 time: 0.156826 Jun 21 19:12:06.993910 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 416/843] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:06 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:08.010393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:08.011005 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:08.017649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:08.018597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:08.019356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:08.019787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:08.148963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:08.156377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-83c3480c-82ea-4b38-a8e9-a26809c942b3 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1454 microversion: 2.1 time: 0.149833 Jun 21 19:12:08.156923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 428/844] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:08 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:08.172591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:08.173232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:08.179668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:08.180110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:08.180862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:08.181318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:08.314902 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:08.322628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b788b89b-c69c-4f86-b19a-e26f8f35e7b4 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1454 microversion: 2.1 time: 0.153699 Jun 21 19:12:08.323408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 417/845] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:08 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:10.260963 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-7605fba7-1f46-4802-b8ad-6a79e3b30cb0 req-9c44c3d8-4383-423d-86ff-905c0896c8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675894b3-7569-4b40-9ab8-f43a4d9d5450", "tag": "1662bf13-bcce-4c24-bb2c-c08c77cc2065"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:10.270029 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7605fba7-1f46-4802-b8ad-6a79e3b30cb0 req-9c44c3d8-4383-423d-86ff-905c0896c8a0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:10.270563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7605fba7-1f46-4802-b8ad-6a79e3b30cb0 req-9c44c3d8-4383-423d-86ff-905c0896c8a0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:10.282080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-7605fba7-1f46-4802-b8ad-6a79e3b30cb0 req-9c44c3d8-4383-423d-86ff-905c0896c8a0 service nova] Creating event network-changed:1662bf13-bcce-4c24-bb2c-c08c77cc2065 for instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 on hv-cinder-84630 Jun 21 19:12:10.287856 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-7605fba7-1f46-4802-b8ad-6a79e3b30cb0 req-9c44c3d8-4383-423d-86ff-905c0896c8a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Jun 21 19:12:10.288564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 429/846] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:12:12.101524 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:12.102106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:12.108551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:12.109004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:12.109795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:12.110230 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:12.133721 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9f847ef1-369f-4380-b5ed-605484fc8471 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036052 Jun 21 19:12:12.134291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 418/847] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jun 21 19:12:12 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:12:13.857930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:13.858484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:13.865511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:13.865968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:13.866730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:13.867166 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:13.889284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lazy-loading 'flavor' on Instance uuid c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:12:14.154177 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b63a0d91-d42f-4f4f-a0ab-fbffed69a7a1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/action" status: 202 len: 0 microversion: 2.20 time: 0.300572 Jun 21 19:12:14.154995 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 430/848] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 19:12:13 2022] POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:12:14.163770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:14.164792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:14.171605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:14.172061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:14.173271 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:14.173927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:14.311486 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:14.320105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:14.321647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:14.322842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fc503ca8-de4d-47a2-bbed-910581883119 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.163028 Jun 21 19:12:14.323401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 419/849] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:14 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:15.342221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:15.342933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:15.349921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:15.350377 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:15.351153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:15.351594 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:15.486096 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:15.494826 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:15.496317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:15.497507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f7888c8a-e97e-43d2-9382-7c13b8af9c4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.160125 Jun 21 19:12:15.498057 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 431/850] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:15 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:16.515860 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:16.516494 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:16.523017 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:16.523461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:16.524213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:16.524643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:16.659880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:16.667858 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:16.669389 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:16.670549 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6b6c9a11-fc50-4061-8a50-f9220686f725 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.158560 Jun 21 19:12:16.671109 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 420/851] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:16 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:17.689418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:17.690550 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:17.697173 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:17.697628 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:17.698413 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:17.698831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:17.831121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:17.839175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:17.840722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:17.841896 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ccb2855e-8919-4e67-aef1-0d632705f81b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.156421 Jun 21 19:12:17.842444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 432/852] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:17 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:18.859855 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:18.860466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:18.867112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:18.867590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:18.868352 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:18.868786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:19.003041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:19.011199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:19.012636 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:19.013836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c5b13a08-106f-41dd-aeff-a108a80b6a31 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.157871 Jun 21 19:12:19.014487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 421/853] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:18 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:20.031882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:20.032501 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:20.039787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:20.040242 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:20.041021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:20.041489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:20.177549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:20.185617 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:20.187123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:20.188301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-60ebfb9c-8244-4c4f-821f-355699d3751c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.160383 Jun 21 19:12:20.188975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 433/854] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:20 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:21.207746 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:21.208380 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:21.210676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:21.216196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:21.216645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:21.217438 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:21.217874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:21.222865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=81 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:21.351009 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:21.358998 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:21.360480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:21.361669 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f1ad9de8-2025-424b-957f-008cb96f530c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.158466 Jun 21 19:12:21.362225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 422/855] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:21 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:22.380271 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:22.380986 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:22.383549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=31 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:22.389194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:22.389650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:22.390440 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:22.390882 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:22.393572 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:22.525809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:22.533743 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:22.535246 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:22.536414 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1917113c-82ab-4c0a-945e-ee408f33cdb2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.160752 Jun 21 19:12:22.536962 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 434/856] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:22 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:23.554582 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:23.555177 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:23.561811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:23.562257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:23.563021 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:23.563454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:23.693668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:23.701779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:23.703283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:23.704452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7d951083-6605-45f4-b804-8c76e96ae373 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.153747 Jun 21 19:12:23.705015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 423/857] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:23 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:24.722504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:24.723126 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:24.730051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:24.730494 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:24.731262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:24.731698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:24.866274 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:24.874268 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:24.875777 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:24.877004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8f3832d3-b2c7-4ad6-ac95-ce1c89095f13 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.158582 Jun 21 19:12:24.877591 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 435/858] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:24 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:25.896301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:25.896942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:25.903204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:25.903662 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:25.904430 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:25.904869 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.035895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:26.044805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:26.046510 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:26.047479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e41a66cd-2794-4141-8924-30c25b528667 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.155878 Jun 21 19:12:26.048226 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 424/859] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:25 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:26.643805 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:26.644349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:26.651553 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:26.652018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.652793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:26.653276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.679556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:12:26.704373 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-3a42753f-0965-4b52-9687-1f655ac149ee req-9f4322e1-a917-4bc9-bdc9-6eecb5d6af6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:26.712837 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-3a42753f-0965-4b52-9687-1f655ac149ee req-9f4322e1-a917-4bc9-bdc9-6eecb5d6af6b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:26.713321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-3a42753f-0965-4b52-9687-1f655ac149ee req-9f4322e1-a917-4bc9-bdc9-6eecb5d6af6b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.726471 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-3a42753f-0965-4b52-9687-1f655ac149ee req-9f4322e1-a917-4bc9-bdc9-6eecb5d6af6b service nova] Creating event network-changed:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:12:26.731740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-3a42753f-0965-4b52-9687-1f655ac149ee req-9f4322e1-a917-4bc9-bdc9-6eecb5d6af6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089467 Jun 21 19:12:26.732653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 425/860] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:12:26.771521 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cec7a7d4-eea0-440e-be8f-ac45dfa753f6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 204 len: 0 microversion: 2.1 time: 0.130562 Jun 21 19:12:26.773234 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 436/861] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:12:26 2022] DELETE /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:12:26.782674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:26.784008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:26.790637 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:26.791082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.791845 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:26.792444 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:26.934526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:26.942382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-54c83b16-4c88-4ab5-bbdb-bd66837d536f tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.164540 Jun 21 19:12:26.943004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 426/862] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:26 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:27.067076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:27.067792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:27.073761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:27.074212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:27.074992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:27.075437 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:27.209058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:27.217167 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:27.218762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:27.219867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3d82290e-1758-417f-a9d7-51b0d84ccb4f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.157453 Jun 21 19:12:27.220649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 437/863] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:27 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:27.959800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:27.960423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:27.966917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:27.967365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:27.968136 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:27.968580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:28.186696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:28.194649 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cbbae2ca-5648-469f-b174-0ea730cf026e tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1568 microversion: 2.1 time: 0.238696 Jun 21 19:12:28.195218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 427/864] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:27 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:28.239008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:28.239615 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:28.246215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:28.246660 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:28.247433 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:28.247868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:28.413790 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:28.421691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:28.423170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:28.424319 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-409e2d02-9204-4cae-bb95-e0dc7a682d56 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.189969 Jun 21 19:12:28.424865 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 438/865] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:28 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:29.211498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:29.212113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:29.218880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:29.219336 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:29.220115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:29.220643 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:29.412235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:29.419866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f440b26e-6d82-46cb-b505-afb56aebec63 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1450 microversion: 2.1 time: 0.212147 Jun 21 19:12:29.420443 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 428/866] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:29 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1450 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:29.444181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:29.444806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:29.451670 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:29.453075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:29.453968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:29.454418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:29.515327 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-be72d906-53c7-446a-b85b-558fde69143e req-ff10d73b-07cc-439a-abef-2a934cca092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc26e7fb-be01-453e-b8bc-098c1312dde5", "name": "network-vif-deleted", "tag": "3e908b64-66f9-42fd-add5-3ce54f7fee68"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:29.526356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-be72d906-53c7-446a-b85b-558fde69143e req-ff10d73b-07cc-439a-abef-2a934cca092c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:29.526802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-be72d906-53c7-446a-b85b-558fde69143e req-ff10d73b-07cc-439a-abef-2a934cca092c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:29.539726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-be72d906-53c7-446a-b85b-558fde69143e req-ff10d73b-07cc-439a-abef-2a934cca092c service nova] Creating event network-vif-deleted:3e908b64-66f9-42fd-add5-3ce54f7fee68 for instance cc26e7fb-be01-453e-b8bc-098c1312dde5 on hv-cinder-84630 Jun 21 19:12:29.545022 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-be72d906-53c7-446a-b85b-558fde69143e req-ff10d73b-07cc-439a-abef-2a934cca092c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034109 Jun 21 19:12:29.545633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 429/867] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:12:29.603534 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:29.611999 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:29.613546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:29.614710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-cd181e59-dc29-4a7d-8ef5-f32cec9779d3 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.176303 Jun 21 19:12:29.615250 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 439/868] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:29 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:30.438391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:30.439086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:30.446078 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:30.446518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:30.447263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:30.447691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:30.479107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:30.479549 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:30.479995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lazy-loading 'fault' on Instance uuid cc26e7fb-be01-453e-b8bc-098c1312dde5 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:12:30.521107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19aa025ff3046229cf0b8041058285e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4202625ef50b44de9a96563feb874a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:30.528689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14fbd2dd-8326-4799-8864-889a9f5cb6b0 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 200 len: 1224 microversion: 2.1 time: 0.094981 Jun 21 19:12:30.529289 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 430/869] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:30 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:12:30.633303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:30.633872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:30.640325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:30.640852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:30.641699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:30.642150 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:30.775438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:30.783473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:30.784979 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:30.786418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-035c401e-dc69-4835-b56d-47768928baef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.157131 Jun 21 19:12:30.786975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 440/870] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:30 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:31.545863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:31.546400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] [instance: cc26e7fb-be01-453e-b8bc-098c1312dde5] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:31.552920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:31.553413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:31.554169 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:31.554620 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:31.715377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] HTTP exception thrown: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Request method failure captured: Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 HTTP/1.1 Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishaDTR4ncLdCGG9fE4KXkpokkAc4lDSkWj0I3y5q4g2KejzN-at8yRsYKPoEi4crQ2OUetW94nYWVcTSv_9-RtWOEiDutiwtgmMDS7TVgK7JohPfHHC805uLPW9XdC9Y3ltbi20ulDomk7RLDNicge2e8JiLXwEgwwfVidvTU7SMQkw Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 4202625ef50b44de9a96563feb874a5a Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestShelveInstance-415457208 Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:12:31.717041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4202625ef50b44de9a96563feb874a5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4202625ef50b44de9a96563feb874a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4202625ef50b44de9a96563feb874a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4202625ef50b44de9a96563feb874a5a"}]}] Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestShelveInstance-415457208 Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 4202625ef50b44de9a96563feb874a5a Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestShelveInstance-415457208 Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestShelveInstance-415457208-project Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: c19aa025ff3046229cf0b8041058285e Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestShelveInstance-415457208-project Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. Jun 21 19:12:31.718698 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'cc26e7fb-be01-453e-b8bc-098c1312dde5'} Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:12:31.719625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. Jun 21 19:12:31.721461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:12:31.722809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Returning 404 to user: Instance cc26e7fb-be01-453e-b8bc-098c1312dde5 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:12:31.722809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5a065aea-dc8f-4874-9e63-83cd6e6a906c tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5" status: 404 len: 111 microversion: 2.1 time: 0.176526 Jun 21 19:12:31.722809 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 431/871] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:12:31 2022] GET /compute/v2.1/servers/cc26e7fb-be01-453e-b8bc-098c1312dde5 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:12:31.803921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:31.804452 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:31.811004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:31.811467 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:31.812249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:31.812696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:31.890388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-252a0c12-4e77-4fdb-97ec-ec7a294028b6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] Calling method '.version_select at 0x7f35957bd9d0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:31.914117 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-252a0c12-4e77-4fdb-97ec-ec7a294028b6 tempest-TestShelveInstance-415457208 tempest-TestShelveInstance-415457208-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1860756024" status: 202 len: 0 microversion: 2.1 time: 0.028053 Jun 21 19:12:31.914745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 432/872] 10.222.0.70 () {58 vars in 1253 bytes} [Tue Jun 21 19:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1860756024 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:12:31.969484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:31.977819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:31.979327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:31.980519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ebf22674-fa1b-4f8d-998e-0096424f9e6c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.180560 Jun 21 19:12:31.981072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 441/873] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:31 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:33.000465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:33.001072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:33.007372 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:33.007813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:33.008671 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:33.009335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:33.159207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:33.167220 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:33.168704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:33.169927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ef92a43e-7daf-4a73-b35a-cf0c39fb8960 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.173898 Jun 21 19:12:33.170465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 433/874] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:32 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:34.187890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:34.188633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:34.196007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:34.196536 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:34.197355 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:34.197803 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:34.334724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:34.346827 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:34.348347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:34.349570 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a62b43c1-2171-4554-a4eb-f38628f45a22 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.165659 Jun 21 19:12:34.350128 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 442/875] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:34 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:34.663840 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-34a87d50-6a89-4678-b191-258c73957e47 req-81b52454-8090-49a8-80fb-ee70de7b3729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "name": "network-vif-plugged", "status": "completed", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:34.672647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-34a87d50-6a89-4678-b191-258c73957e47 req-81b52454-8090-49a8-80fb-ee70de7b3729 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:34.673381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-34a87d50-6a89-4678-b191-258c73957e47 req-81b52454-8090-49a8-80fb-ee70de7b3729 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:34.685334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-34a87d50-6a89-4678-b191-258c73957e47 req-81b52454-8090-49a8-80fb-ee70de7b3729 service nova] Creating event network-vif-plugged:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:12:34.699000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-34a87d50-6a89-4678-b191-258c73957e47 req-81b52454-8090-49a8-80fb-ee70de7b3729 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038633 Jun 21 19:12:34.700645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 434/876] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:12:35.366710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:35.368063 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:35.375316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:35.376108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:35.377681 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:35.378337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:35.625818 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:35.634545 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:35.636055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:35.637317 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7585406a-fd3f-4dc8-9628-bc189b93db0d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.274472 Jun 21 19:12:35.637877 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 443/877] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:35 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:36.656887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:36.657686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:36.664797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:36.665325 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:36.666109 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:36.666548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:36.913504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:36.921730 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:36.923230 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:36.924403 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4fde8e80-6e05-45ad-8651-e15e42cfeef7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.272233 Jun 21 19:12:36.924964 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 435/878] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:36 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:37.943183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:37.943813 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:37.950903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:37.951358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:37.952158 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:37.952602 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:38.246638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:38.259204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:38.260718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:38.261940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2bef5ab5-a3fd-42c6-966e-c4bf4ed470ff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1745 microversion: 2.20 time: 0.323301 Jun 21 19:12:38.271804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 444/879] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:37 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1745 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:39.280077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:39.281011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:39.289779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:39.290490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:39.291503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:39.292153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:39.453407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:39.462201 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:39.463687 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:39.464986 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8c33fd21-92b4-465e-bf8e-6db005b0714d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.188889 Jun 21 19:12:39.465562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 436/880] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:39 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:40.484290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:40.484920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:40.491855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:40.492345 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:40.493235 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:40.493685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:40.676041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:40.688605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:40.692614 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:40.694654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e67727b9-257d-400e-a56a-9d579003c434 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.213907 Jun 21 19:12:40.697429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 445/881] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:40 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:41.715356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:41.716136 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:41.724440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:41.725299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:41.726531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:41.727040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:42.239409 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:42.247736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:42.249363 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:42.250530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cfdcad13-f7b5-40fb-b231-66a20655ed16 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.539294 Jun 21 19:12:42.251083 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 437/882] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:41 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:43.269804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:43.270538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:43.276683 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:43.277161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:43.277931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:43.278364 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:43.420899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:43.430544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:43.432670 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:43.435143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f4c80235-b40d-4e52-b5c2-f798574e23a8 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.169070 Jun 21 19:12:43.435713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 446/883] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:43 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:44.455277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:44.456142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:44.462253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:44.462704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:44.463481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:44.463920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:44.610434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:44.619787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:44.621466 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:44.622818 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ec5e52f4-452f-4f31-bc37-438f685159d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.171388 Jun 21 19:12:44.623539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 438/884] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:44 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:45.655523 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:45.656130 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:45.663287 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:45.663751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:45.664507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:45.664940 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:45.828167 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:45.838165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:45.839739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:45.841305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1ed05a42-8262-45f6-a8ff-558ba80a1c3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.190253 Jun 21 19:12:45.842231 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 447/885] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:45 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:12:46.860744 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:46.862294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:46.869735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:46.870240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:46.871033 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:46.871473 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:47.062328 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:47.071740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:47.073321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:47.074683 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6733d445-f012-45d3-b9fe-4e5699d962d2 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.218389 Jun 21 19:12:47.086791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 439/886] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:46 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:48.092953 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:48.093588 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:48.100947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:48.101439 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:48.102245 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:48.102684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:48.260360 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:48.269768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:48.271432 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:48.272775 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f8778ba9-c62a-4900-84b0-370ebc8b770e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.183693 Jun 21 19:12:48.273394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 448/887] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:48 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:49.292428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:49.293151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:49.300775 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:49.301253 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:49.302026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:49.302463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:49.445959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:49.454534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:49.456723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:49.457995 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1dff5f6f-32e4-4af0-becc-7842ae084b20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1740 microversion: 2.20 time: 0.170074 Jun 21 19:12:49.458595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 440/888] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:49 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:50.477350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:50.477996 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:50.484465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:50.484913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:50.485728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:50.486734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:50.489421 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:50.691571 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:50.700309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:50.701915 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:50.703078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-038f1496-323c-4688-b99e-dbd291115f32 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1722 microversion: 2.20 time: 0.229678 Jun 21 19:12:50.703633 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 449/889] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:50 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:51.849753 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:51.850646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:51.852869 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:51.858602 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:51.859055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:51.859867 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:51.860301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:51.865783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=94 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:51.995338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:52.003181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:52.004672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:52.005870 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f171baed-56ec-4026-a706-58dc710b81bb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1722 microversion: 2.20 time: 0.286666 Jun 21 19:12:52.006432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 441/890] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:51 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:53.023739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:53.024339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:53.026729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:12:53.032563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.033131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.033907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.034336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.165292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:53.173161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:53.175176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:53.176327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5ed461fe-3ad8-47ab-af18-6e7b8342c90a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1725 microversion: 2.20 time: 0.156513 Jun 21 19:12:53.176879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 450/891] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:53 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:53.194377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b364a7-ca02-4314-9081-b03febf8432f"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:53.195825 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:53.202810 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.203329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.204215 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.204679 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.483147 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-994f967e-d800-4ddf-9886-3fcda65d8356 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293519 Jun 21 19:12:53.483751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 442/892] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jun 21 19:12:53 2022] POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 19:12:53.596449 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:53.596949 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:53.603131 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.603580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.604350 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.604782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.842510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c80f26fa-0dc0-4ea5-a038-1e20e6e3dbff tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments/d4b364a7-ca02-4314-9081-b03febf8432f" status: 202 len: 0 microversion: 2.20 time: 0.250476 Jun 21 19:12:53.843099 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 451/893] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jun 21 19:12:53 2022] DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments/d4b364a7-ca02-4314-9081-b03febf8432f => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:12:53.897922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:53.898491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:53.904640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.905119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.905883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:53.906319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:53.983509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-30003d2b-51df-4903-a15b-966f806d9bf5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/action" status: 202 len: 0 microversion: 2.20 time: 0.089510 Jun 21 19:12:53.984138 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 443/894] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 19:12:53 2022] POST /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:12:53.992292 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:53.993162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:54.000071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:54.000530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:54.001336 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:54.001778 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:54.145822 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:54.154048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:54.155541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:54.156701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d57045c9-3233-40b1-b562-a88cd3e6e7ef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1673 microversion: 2.20 time: 0.168382 Jun 21 19:12:54.157272 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 452/895] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:53 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:54.573599 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-1823f999-b0af-4106-b336-df6e261b3acc req-95afbcd4-adcc-4478-9cb1-8eae2ce12dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "name": "network-vif-unplugged", "status": "completed", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:12:54.583115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-1823f999-b0af-4106-b336-df6e261b3acc req-95afbcd4-adcc-4478-9cb1-8eae2ce12dee service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:54.583770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-1823f999-b0af-4106-b336-df6e261b3acc req-95afbcd4-adcc-4478-9cb1-8eae2ce12dee service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:54.601494 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.compute.server_external_events [req-1823f999-b0af-4106-b336-df6e261b3acc req-95afbcd4-adcc-4478-9cb1-8eae2ce12dee service nova] Unable to find a host for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e. Dropping event network-vif-unplugged {{(pid=117618) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 19:12:54.602426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-1823f999-b0af-4106-b336-df6e261b3acc req-95afbcd4-adcc-4478-9cb1-8eae2ce12dee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033200 Jun 21 19:12:54.603026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 444/896] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 19:12:55.175510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:55.176124 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:55.182851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:55.183304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:55.184115 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:55.184551 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:55.391977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:55.400497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:55.402024 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:55.403194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da63ba69-096e-495e-8c32-1f8e3f208d8b tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.232154 Jun 21 19:12:55.403748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 453/897] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:55 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:56.422689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:56.423332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:56.437446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:56.438153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:56.439062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:56.439586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:56.607851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:56.617262 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:56.618781 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:56.619969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dc7d0b26-de65-4fac-ac42-907b38456b4e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.201400 Jun 21 19:12:56.630983 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 445/898] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:56 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:57.638450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:57.639277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:57.645545 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:57.645993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:57.646746 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:57.647175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:57.775149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:57.783361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:57.784868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:57.786077 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6ac94a30-e2ad-45c9-a3a7-bfb5a4965080 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.151709 Jun 21 19:12:57.786636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 454/899] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:57 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:12:58.804865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:12:58.805817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:12:58.815541 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:58.816391 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:58.817228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:12:58.817676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:12:58.975941 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:58.984208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:58.986289 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:12:58.987465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-924ec404-0e66-4861-85ac-43e097016dfb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.187099 Jun 21 19:12:58.988011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 446/900] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:12:58 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:00.006281 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:00.006893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:00.013555 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:00.013998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:00.014757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:00.015185 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:00.159259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:00.171584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:00.173344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:00.175229 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef1d5861-eb7c-400c-aad0-9ccb4b02c59e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.173540 Jun 21 19:13:00.175890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 455/901] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:00 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:01.194151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:01.194752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:01.201382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:01.201824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:01.202586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:01.203017 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:01.339438 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:01.348478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:01.350140 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:01.351407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b84c6938-1c85-4fb1-ae90-afe541c64256 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.161365 Jun 21 19:13:01.362922 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 447/902] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:01 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:02.369492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:02.370120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:02.377121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:02.377583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:02.378356 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:02.378796 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:02.528305 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:02.536430 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:02.537964 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:02.539113 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-15a9dc04-d575-4b66-855b-046fa0190385 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.173646 Jun 21 19:13:02.539664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 456/903] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:02 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:03.381462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:03.382128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:03.388777 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:03.389258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:03.390029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:03.390462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:03.415832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aebfad52-4481-49e6-b669-d5a87f1a4707 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/ips" status: 200 len: 149 microversion: 2.1 time: 0.038290 Jun 21 19:13:03.416410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 448/904] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:13:03 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:03.558438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:03.559060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:03.567078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:03.567881 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:03.568886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:03.569564 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:03.726547 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:03.737348 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:03.739297 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:03.740573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-db41fe6a-b8d0-41c1-aa29-835cdf378b10 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.186707 Jun 21 19:13:03.741507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 457/905] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:03 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:04.758625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:04.759255 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:04.766074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:04.766526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:04.767307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:04.767745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:04.807487 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:04.809483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:04.816955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:04.817710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:04.821274 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:04.822025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:04.859696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-eeb59fb0-e920-4a5f-8242-498b5af66c76 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/ips" status: 200 len: 147 microversion: 2.1 time: 0.056026 Jun 21 19:13:04.860663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 458/906] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:13:04 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/ips => generated 147 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:04.963124 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:04.972341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:04.974258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:04.975465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-59f4039a-137e-42b8-be53-530aff2d06b1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.220821 Jun 21 19:13:04.976026 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 449/907] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:04 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:13:05.922546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2c1c6e-c6dc-43ca-879c-06e999798b82"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:05.924188 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:05.930760 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:05.931210 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:05.931988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:05.932425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:05.995097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:05.995787 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:06.005458 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:06.007468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:06.008547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:06.009114 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:06.151426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:06.161210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:06.162882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:06.164451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7377da9e-7d6d-47be-9a0c-3d2aeb5452e0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.173112 Jun 21 19:13:06.165016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 450/908] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:05 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:07.188732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:07.191691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:07.200092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:07.200535 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:07.201324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:07.201752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:07.342699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:07.350738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:07.352269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:07.353597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8218fc7a-0b05-4a8d-a46e-b56f901efe73 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.173121 Jun 21 19:13:07.354150 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 451/909] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:07 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:07.358804 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cdde2e0-5f9c-453a-a35c-61dbd762b29a"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:07.360146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:07.366887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:07.367341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:07.368122 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:07.368566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:15.436872 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1b712d5b-2317-4eef-8844-e711aa9e59b6 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.081515 Jun 21 19:13:15.437690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 452/910] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:13:07 2022] POST /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 194 bytes in 8083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:15.439068 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-06600d8a-84cb-4c2f-acd7-6e0bdfe2cb6c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.520212 Jun 21 19:13:15.441820 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 459/911] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:13:05 2022] POST /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments => generated 194 bytes in 9524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:15.443433 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:15.444203 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:15.452091 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:15.452627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:15.453623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:15.454342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:15.600956 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:15.606636 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:15.609764 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:15.611450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:15.612386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-52207b67-8bfe-4f70-bb5d-f3753395f7d5 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.173628 Jun 21 19:13:15.612942 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 453/912] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:15 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:16.628332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=19 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:16.632690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:16.633425 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:16.639874 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:16.640332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:16.641112 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:16.641556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:16.774387 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:16.782762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:16.784812 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:16.786011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1d9fcdf3-2bc4-40d3-a68f-4477694ca1a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.159068 Jun 21 19:13:16.786829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 460/913] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:16 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:17.804898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:17.805520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:17.813058 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:17.813538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:17.814307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:17.814797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:17.948597 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:17.956093 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:17.957628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:17.958793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-318254f5-6a19-4cbc-bdc1-aae5fd63704c tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.158658 Jun 21 19:13:17.959343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 454/914] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:17 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:18.764694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-88027890-44b6-4da0-bf61-0955c3395622 req-fb8bccb5-d9e0-4436-af9f-0f7e1c548853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "name": "network-vif-plugged", "status": "completed", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:18.774041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-88027890-44b6-4da0-bf61-0955c3395622 req-fb8bccb5-d9e0-4436-af9f-0f7e1c548853 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:18.774499 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-88027890-44b6-4da0-bf61-0955c3395622 req-fb8bccb5-d9e0-4436-af9f-0f7e1c548853 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:18.786281 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-88027890-44b6-4da0-bf61-0955c3395622 req-fb8bccb5-d9e0-4436-af9f-0f7e1c548853 service nova] Creating event network-vif-plugged:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:13:18.791158 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-88027890-44b6-4da0-bf61-0955c3395622 req-fb8bccb5-d9e0-4436-af9f-0f7e1c548853 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Jun 21 19:13:18.791739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 461/915] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:18.977241 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:18.977898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:18.985280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:18.985738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:18.986511 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:18.986949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:19.158904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:19.166920 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:19.168419 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:19.169627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-487f7e78-c4ca-4012-a605-050bb9e7ecb7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.196276 Jun 21 19:13:19.170205 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 455/916] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:18 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:20.188796 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:20.189522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:20.196029 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:20.196489 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:20.197289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:20.197734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:20.333466 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:20.336924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:20.342385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:20.343884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:20.345043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-75568eaf-53dc-4969-b3c1-4ca3195716bd tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.161083 Jun 21 19:13:20.345629 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 462/917] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:20 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:21.363048 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:21.363661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:21.370754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:21.371206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:21.371975 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:21.372440 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:21.506390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:21.514816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:21.516592 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:21.517800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72b78d1c-2f9e-4995-a3da-6828128a4022 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1731 microversion: 2.20 time: 0.158628 Jun 21 19:13:21.518422 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 456/918] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:21 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:22.536514 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:22.537060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:22.544712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:22.545195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:22.545960 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:22.546394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:22.678989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:22.686851 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:22.688343 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:22.689527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3fe9e8fa-02c1-407c-9bb9-9e22e7036cdb tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1718 microversion: 2.20 time: 0.157597 Jun 21 19:13:22.690074 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 463/919] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:13:22 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:13:22.982421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:22.983354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:22.985623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=34 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:22.991546 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:22.992017 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:22.992760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:22.993227 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:23.023189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-13b79a7f-6e8d-480d-a98a-b96ffec2149e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Jun 21 19:13:23.023736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 457/920] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:13:22 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:23.033509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:23.034040 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:23.040762 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:23.041258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:23.042036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:23.042479 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:23.073412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c0786094-d4f7-4c4b-87f1-4da91990b30c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a" status: 200 len: 194 microversion: 2.1 time: 0.043683 Jun 21 19:13:23.073883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 464/921] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 19:13:23 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:24.382455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c699a220-a726-498c-9bc7-9741001c9896"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:24.383516 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:24.390014 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:24.390454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:24.391211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:24.391639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:24.624496 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7d7f8d15-2d68-41a5-87eb-4d9c74e8c38e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "POST /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245717 Jun 21 19:13:24.625195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 458/922] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:13:24 2022] POST /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:29.254314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4a9c0d48-b491-4b1a-86e7-fc0d9790cea6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: .version_select at 0x7f35958e48b0>, body: {"keypair": {"name": "tempest-keypair-653216461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlJvPfFq5jDNIX8GVdXIKgBT+/8g66fUvj+KIvlv9uZa05UkZhNKMNC5qUlxUZ48QDWcdIWaGDzhTzXG11iPYPgjZvoVHXhSoHPZABUNnX90B+UB2I5tjbO4m6q6dAR9w=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:29.268484 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-4a9c0d48-b491-4b1a-86e7-fc0d9790cea6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:13:29.272258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-4a9c0d48-b491-4b1a-86e7-fc0d9790cea6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:13:29.295639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4a9c0d48-b491-4b1a-86e7-fc0d9790cea6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045475 Jun 21 19:13:29.296361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 465/923] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:13:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:30.564424 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2064729298", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e9591ce-30ff-4920-8896-3d382a8c79e7"}], "security_groups": [{"name": "tempest-securitygroup--1102359406"}], "key_name": "tempest-keypair-653216461", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:30.667971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] validate_networks() for [('8e9591ce-30ff-4920-8896-3d382a8c79e7', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:13:31.045657 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:13:31.046088 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:13:31.046566 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:13:31.046981 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:13:31.047397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:13:31.056456 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:31.056907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:31.057738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:31.058178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:31.074822 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:13:31.078751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:13:31.090398 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:13:31.092722 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:13:31.139308 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4b4e2e5c-6b66-4a87-9412-3e8a59ba716f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579472 Jun 21 19:13:31.139940 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 459/924] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:13:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:13:31.150541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f91f3692-a3ba-4e79-985a-c02730352ae2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:31.151170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f91f3692-a3ba-4e79-985a-c02730352ae2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:31.206582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f91f3692-a3ba-4e79-985a-c02730352ae2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:31.215821 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f91f3692-a3ba-4e79-985a-c02730352ae2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1241 microversion: 2.1 time: 0.069887 Jun 21 19:13:31.216382 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 466/925] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:31 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:32.234777 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:32.235536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:32.242666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:32.243197 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:32.244096 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:32.244608 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:32.312928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:32.320786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e3bb7e0b-208e-41f4-85d8-781120d871f4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1299 microversion: 2.1 time: 0.091160 Jun 21 19:13:32.321589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 460/926] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:32 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:13:33.338581 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:33.340092 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:33.342544 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:33.347935 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:33.348828 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:33.349871 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:33.350543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:33.545035 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:33.552556 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a8bd16a4-f389-460a-a0b6-102ed9f01d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.218490 Jun 21 19:13:33.553140 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 467/927] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:33 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:33.581690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-0e1cc91a-3d8a-4362-b448-8d73dc677e37 req-5915d587-3b9d-437b-a42a-d2cf495364bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3bb88a5-7007-4d70-ad69-a0b2c4307f53", "tag": "c7e2fa1a-911f-460c-897f-d05c13a839cc"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:33.591074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0e1cc91a-3d8a-4362-b448-8d73dc677e37 req-5915d587-3b9d-437b-a42a-d2cf495364bb service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:33.591291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-0e1cc91a-3d8a-4362-b448-8d73dc677e37 req-5915d587-3b9d-437b-a42a-d2cf495364bb service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:33.608275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-0e1cc91a-3d8a-4362-b448-8d73dc677e37 req-5915d587-3b9d-437b-a42a-d2cf495364bb service nova] Creating event network-changed:c7e2fa1a-911f-460c-897f-d05c13a839cc for instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 on hv-cinder-84630 Jun 21 19:13:33.612954 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-0e1cc91a-3d8a-4362-b448-8d73dc677e37 req-5915d587-3b9d-437b-a42a-d2cf495364bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034880 Jun 21 19:13:33.613588 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 461/928] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:34.569582 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:34.570200 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:34.576753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:34.577241 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:34.578018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:34.578463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:34.714315 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:34.721984 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f50fc32f-7386-48a3-89f4-68aaf544f2a7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.156550 Jun 21 19:13:34.722546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 468/929] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:34 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:35.739548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:35.740238 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:35.746994 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:35.747437 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:35.748213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:35.748653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:35.878074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:35.885423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c52c5425-8c40-4c77-8347-90d47dc033d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.150492 Jun 21 19:13:35.885991 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 462/930] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:35 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:36.901654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:36.902277 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:36.908757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:36.909242 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:36.910014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:36.910455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:37.036560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:37.044080 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bd96aa45-6710-4347-9381-d8aeaae974b2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.146457 Jun 21 19:13:37.044650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 469/931] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:36 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:38.061509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:38.062240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:38.069223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.069711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.071004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.071444 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.283526 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:38.291944 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cdebe44f-555c-4a0e-934f-dc0f39c4fa12 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.234265 Jun 21 19:13:38.292686 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 463/932] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:38 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:38.474867 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:38.475729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:38.482338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.482793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.483567 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.484006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.526734 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b9fcaca9-a019-4e7b-bf94-5bdd84c8c34b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055705 Jun 21 19:13:38.527247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 470/933] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:13:38 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:38.666426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:38.666919 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:38.681106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.681562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.682348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.682925 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.725226 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e1189aa3-4758-4cd2-95af-acf618132d85 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a" status: 200 len: 194 microversion: 2.1 time: 0.063171 Jun 21 19:13:38.725735 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 464/934] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 19:13:38 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:38.736058 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:38.736565 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:38.744795 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.745296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.746098 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.746539 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.846189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lazy-loading 'services' on Instance uuid 5e1c09fb-5000-49a4-9038-a436e59ca472 {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:13:38.929442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0969d6e3-10b7-4cf9-9f06-bc553f4746e9 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a" status: 202 len: 0 microversion: 2.1 time: 0.196803 Jun 21 19:13:38.930573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 471/935] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:13:38 2022] DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/0cdde2e0-5f9c-453a-a35c-61dbd762b29a => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:13:38.931598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-708363fa-6587-460d-a615-63767339510b req-6c2cd74e-2bc0-4777-90d5-185b0bebe4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bb88a5-7007-4d70-ad69-a0b2c4307f53", "name": "network-vif-plugged", "status": "completed", "tag": "c7e2fa1a-911f-460c-897f-d05c13a839cc"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:38.943671 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-708363fa-6587-460d-a615-63767339510b req-6c2cd74e-2bc0-4777-90d5-185b0bebe4a9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:38.944170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-708363fa-6587-460d-a615-63767339510b req-6c2cd74e-2bc0-4777-90d5-185b0bebe4a9 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:38.962515 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-708363fa-6587-460d-a615-63767339510b req-6c2cd74e-2bc0-4777-90d5-185b0bebe4a9 service nova] Creating event network-vif-plugged:c7e2fa1a-911f-460c-897f-d05c13a839cc for instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 on hv-cinder-84630 Jun 21 19:13:38.982528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-708363fa-6587-460d-a615-63767339510b req-6c2cd74e-2bc0-4777-90d5-185b0bebe4a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055966 Jun 21 19:13:38.983025 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 465/936] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:39.312590 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:39.313306 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:39.320073 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:39.320525 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:39.321335 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:39.321777 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:39.499729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:39.507249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-56ea512d-25ec-473e-84e4-36dc335c7610 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.200229 Jun 21 19:13:39.508412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 472/937] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:39 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:40.527040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:40.527773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:40.533978 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:40.534428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:40.535181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:40.535617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:40.666213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:40.673591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b9b08cd3-7a4d-48d0-aaa7-989c60e2a558 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.151731 Jun 21 19:13:40.674151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 466/938] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:40 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:41.113903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:41.114463 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:41.120866 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.121365 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.122145 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.122588 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.152810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bebca98a-2b20-4f29-ab7d-1c1592d9b2e2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/c699a220-a726-498c-9bc7-9741001c9896" status: 200 len: 194 microversion: 2.1 time: 0.043546 Jun 21 19:13:41.153442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 473/939] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 19:13:41 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/c699a220-a726-498c-9bc7-9741001c9896 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:41.164400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:41.164904 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:41.166982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:41.167647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:41.174043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.174504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.175288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.175724 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.259580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lazy-loading 'services' on Instance uuid 5e1c09fb-5000-49a4-9038-a436e59ca472 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:13:41.376293 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-05084123-8b3c-4027-ac16-5ea0b1c75dc4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/c699a220-a726-498c-9bc7-9741001c9896" status: 202 len: 0 microversion: 2.1 time: 0.216181 Jun 21 19:13:41.376875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 467/940] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:13:41 2022] DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments/c699a220-a726-498c-9bc7-9741001c9896 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:13:41.690469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:41.691072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:41.693283 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=6 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:41.699240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.699697 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.702061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:41.702513 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:41.859019 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:41.872747 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da3335a8-a977-4dc3-a34a-c8e06e718391 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1367 microversion: 2.1 time: 0.186127 Jun 21 19:13:41.873374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 474/941] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:41 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:42.892029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:42.892663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:42.899174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:42.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:42.900424 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:42.900866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.045767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:43.053584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-87cefb3a-5761-49a9-9cba-dc0d321253ab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1557 microversion: 2.1 time: 0.166206 Jun 21 19:13:43.054152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 468/942] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:42 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:43.072909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:43.073518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:43.081675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.082138 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.083351 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.084078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.170381 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-df80e1f7-e7ea-4368-bf24-df3a6b8b0b39 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103642 Jun 21 19:13:43.170973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 475/943] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:13:43 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:13:43.612859 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:43.613934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:43.623563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.624311 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.625305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.625831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.655748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a6465a18-b865-4174-a64e-da7d0b64ba7d tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047208 Jun 21 19:13:43.656376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 469/944] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:13:43 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:13:43.767235 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:43.768313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:43.775426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.775977 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.776829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.777374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.807947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-160bbe56-c263-4601-8867-d20546e348a3 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044492 Jun 21 19:13:43.808519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 476/945] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:13:43 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:13:43.866215 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:43.866838 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:43.872896 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.873386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.874163 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:43.874605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:43.890625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:43.904966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:13:43.984926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2952e407-d5ed-41e3-a5df-a262a0f69f8c tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 204 len: 0 microversion: 2.1 time: 0.120892 Jun 21 19:13:43.986606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 470/946] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:13:43 2022] DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:13:43.997206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:43.997946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:44.004469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:44.004956 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:44.005928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:44.006530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:44.261597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:44.269794 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-70625927-8c77-46cf-ad7b-97f6a86edb30 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1676 microversion: 2.1 time: 0.278246 Jun 21 19:13:44.270450 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 477/947] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:43 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1676 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:44.535791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-09d21c78-b6c1-464a-a7a5-2af7e5fbcf8a req-934cbd10-dccb-42c9-adf1-3bf5e9af4762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3bb88a5-7007-4d70-ad69-a0b2c4307f53", "tag": "c7e2fa1a-911f-460c-897f-d05c13a839cc"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:44.544368 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-09d21c78-b6c1-464a-a7a5-2af7e5fbcf8a req-934cbd10-dccb-42c9-adf1-3bf5e9af4762 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:44.544930 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-09d21c78-b6c1-464a-a7a5-2af7e5fbcf8a req-934cbd10-dccb-42c9-adf1-3bf5e9af4762 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:44.557448 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-09d21c78-b6c1-464a-a7a5-2af7e5fbcf8a req-934cbd10-dccb-42c9-adf1-3bf5e9af4762 service nova] Creating event network-changed:c7e2fa1a-911f-460c-897f-d05c13a839cc for instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 on hv-cinder-84630 Jun 21 19:13:44.562591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-09d21c78-b6c1-464a-a7a5-2af7e5fbcf8a req-934cbd10-dccb-42c9-adf1-3bf5e9af4762 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087735 Jun 21 19:13:44.563198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 471/948] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:45.287886 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:45.288543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:45.295431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:45.295883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:45.296669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:45.297133 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:45.433993 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:45.442193 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-89cd839a-0efd-4f70-9c9c-15fd96b50828 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1676 microversion: 2.1 time: 0.157944 Jun 21 19:13:45.442769 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 478/949] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:45 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:46.461188 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:46.461899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:46.468118 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:46.468573 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:46.469365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:46.469802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:46.687223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b973f8f63eb49f19895a43313f2bc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bbb7a5373e46f69acab406d82d87f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:13:46.695534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1775122b-1404-4d3f-998a-c7981ffce0d4 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 200 len: 1676 microversion: 2.1 time: 0.239029 Jun 21 19:13:46.696113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 472/950] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:46 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:13:47.118123 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-2f6f064e-c3b7-4832-aed2-9ca2b7a03ffe req-11cf6b18-5eaf-4278-8a6c-51b1615e8d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1c09fb-5000-49a4-9038-a436e59ca472", "name": "network-vif-deleted", "tag": "7354e441-3d70-4860-8b52-b478e465d4e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:47.122442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:13:47.138854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-2f6f064e-c3b7-4832-aed2-9ca2b7a03ffe req-11cf6b18-5eaf-4278-8a6c-51b1615e8d0e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:47.139609 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-2f6f064e-c3b7-4832-aed2-9ca2b7a03ffe req-11cf6b18-5eaf-4278-8a6c-51b1615e8d0e service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:47.151282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-2f6f064e-c3b7-4832-aed2-9ca2b7a03ffe req-11cf6b18-5eaf-4278-8a6c-51b1615e8d0e service nova] Creating event network-vif-deleted:7354e441-3d70-4860-8b52-b478e465d4e1 for instance 5e1c09fb-5000-49a4-9038-a436e59ca472 on hv-cinder-84630 Jun 21 19:13:47.156087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-2f6f064e-c3b7-4832-aed2-9ca2b7a03ffe req-11cf6b18-5eaf-4278-8a6c-51b1615e8d0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043202 Jun 21 19:13:47.156917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 479/951] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:47.713314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:47.714064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:47.720527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:47.720977 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:47.721784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:47.722224 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:47.735674 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 HTTP/1.1 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:13:47.737378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:47.739074 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '5e1c09fb-5000-49a4-9038-a436e59ca472'} Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:13:47.740168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:47.741768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:47.743235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:13:47.743235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-182adfb2-0129-4bfa-b2d8-e060eaa3abc2 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 404 len: 111 microversion: 2.1 time: 0.030268 Jun 21 19:13:47.743235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 473/952] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:47 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:13:47.749041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a06253ca-5be1-4da8-acce-748b7ce48681 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '.version_select at 0x7f35959b4670>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:47.768390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a06253ca-5be1-4da8-acce-748b7ce48681 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522036316" status: 202 len: 0 microversion: 2.1 time: 0.023844 Jun 21 19:13:47.768974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 480/953] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 19:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522036316 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:13:50.661589 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:50.662082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:50.668595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:50.669048 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:50.669847 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:50.670286 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:50.683865 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 HTTP/1.1 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:13:50.685504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.687116 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '5e1c09fb-5000-49a4-9038-a436e59ca472'} Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:13:50.688082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.689402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.690789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:13:50.690789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-457aeee0-72ac-4822-8600-ea0a8cb26451 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 404 len: 111 microversion: 2.1 time: 0.029140 Jun 21 19:13:50.690789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 474/954] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:13:50 2022] DELETE /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:13:50.696645 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:50.697411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 5e1c09fb-5000-49a4-9038-a436e59ca472] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:50.703509 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:50.703956 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:50.704715 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:50.705181 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:50.718758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 HTTP/1.1 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:13:50.720375 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.722052 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '5e1c09fb-5000-49a4-9038-a436e59ca472'} Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:13:50.723120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. Jun 21 19:13:50.724696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:50.726273 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 5e1c09fb-5000-49a4-9038-a436e59ca472 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:13:50.726273 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-40b2e168-b2c2-4c2a-89d6-c88bfc59d29b tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472" status: 404 len: 111 microversion: 2.1 time: 0.030393 Jun 21 19:13:50.726273 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 481/955] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:50 2022] GET /compute/v2.1/servers/5e1c09fb-5000-49a4-9038-a436e59ca472 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:13:51.861402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:51.862050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:51.868632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:51.869081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:51.869897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:51.870337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:51.883993 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff HTTP/1.1 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:13:51.885623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.887016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '9c71b4bb-1be3-4662-aa0b-78d6acfa27ff'} Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:13:51.887793 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.889030 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.890340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:13:51.890340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4f25f1c1-e5a4-40fe-9f6d-f94feb44385e tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 404 len: 111 microversion: 2.1 time: 0.030463 Jun 21 19:13:51.890340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 475/956] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:13:51 2022] DELETE /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:13:51.895802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:51.896483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] [instance: 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:13:51.904014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:51.904471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:51.905295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:13:51.905738 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:13:51.919885 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] HTTP exception thrown: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Request method failure captured: Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff HTTP/1.1 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXcJZSRkI5mu08mLrWqt1H9TwhJOvqd11j0KoR7YL7wL2uvEL4ohJU2eIC4-WiVNBB1emtLUBTXIzwXyUolMgu1QKisU2LZhkOSsTnNvdiDSvVgDBf0JQL825U7uMdB5tPWv2_dy5v8Xt4hNzOqwF_-e6BKgMOEEtJl5O7Bcfk2moA Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:13:51.921541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6bbb7a5373e46f69acab406d82d87f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6bbb7a5373e46f69acab406d82d87f3"}]}] Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: b6bbb7a5373e46f69acab406d82d87f3 Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1326711802 Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 2b973f8f63eb49f19895a43313f2bc55 Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeTestJSON-1326711802-project Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.923189 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '9c71b4bb-1be3-4662-aa0b-78d6acfa27ff'} Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:13:51.927394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. Jun 21 19:13:51.929266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:13:51.930469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] Returning 404 to user: Instance 9c71b4bb-1be3-4662-aa0b-78d6acfa27ff could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:13:51.930469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c47ee9cf-ad7b-426d-a2b7-7dcba4523523 tempest-AttachVolumeTestJSON-1326711802 tempest-AttachVolumeTestJSON-1326711802-project] 10.222.0.70 "GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff" status: 404 len: 111 microversion: 2.1 time: 0.031047 Jun 21 19:13:51.930469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 482/957] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:13:51 2022] GET /compute/v2.1/servers/9c71b4bb-1be3-4662-aa0b-78d6acfa27ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:13:56.228410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9afa7508-89f1-4393-af7b-184d641addcc tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Action: 'create', calling method: .version_select at 0x7f3595ca4f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1267934076"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:56.520208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9afa7508-89f1-4393-af7b-184d641addcc tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.408225 Jun 21 19:13:56.520879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 476/958] 10.222.0.70 () {60 vars in 1154 bytes} [Tue Jun 21 19:13:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 19:13:56.534994 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5b2c4863-d565-4370-8a07-b68b336ab9b7 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35959a9a60>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:56.590471 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5b2c4863-d565-4370-8a07-b68b336ab9b7 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 200 len: 345 microversion: 2.1 time: 0.061711 Jun 21 19:13:56.591040 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 483/959] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:13:56 2022] GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:57.604055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-55ff7422-2173-4f7c-90d9-dd40e412f395 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35957e5700>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:57.651752 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-55ff7422-2173-4f7c-90d9-dd40e412f395 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 200 len: 346 microversion: 2.1 time: 0.052516 Jun 21 19:13:57.652350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 477/960] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:13:57 2022] GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:57.664316 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-42c58e39-3ccc-4d8a-afc3-e427f65ebf62 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Action: 'create', calling method: .version_select at 0x7f35959b6700>, body: {"snapshot": {"volume_id": "52ccd08c-f602-40ea-81f2-1d91d9f0f537", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1444983260"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:13:57.810255 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-42c58e39-3ccc-4d8a-afc3-e427f65ebf62 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.150693 Jun 21 19:13:57.811030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 484/961] 10.222.0.70 () {60 vars in 1161 bytes} [Tue Jun 21 19:13:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:57.821268 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-135b3cf2-f4df-445a-8337-faf7120bf548 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595953e50>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:57.854261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-135b3cf2-f4df-445a-8337-faf7120bf548 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.037240 Jun 21 19:13:57.854788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 478/962] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:13:57 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:57.864716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-19266dac-709a-419b-a6fd-f0891e5d814d tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35959b6a60>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:57.892584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-19266dac-709a-419b-a6fd-f0891e5d814d tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031855 Jun 21 19:13:57.893167 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 485/963] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jun 21 19:13:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:57.903964 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-afd7c8d6-4385-415f-9bb0-09e9e16b948b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595953940>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:57.933574 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-afd7c8d6-4385-415f-9bb0-09e9e16b948b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.033314 Jun 21 19:13:57.934208 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 479/964] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:13:57 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:58.946284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a8f8db79-40c3-488b-8018-23c490dde007 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595c15940>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:13:58.975309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a8f8db79-40c3-488b-8018-23c490dde007 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.033507 Jun 21 19:13:58.976399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 486/965] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:13:58 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:13:59.988174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cb51ebd4-54ea-4cdc-a643-14b46c5f1b95 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595cf0b80>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:00.018512 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cb51ebd4-54ea-4cdc-a643-14b46c5f1b95 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.034663 Jun 21 19:14:00.019060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 480/966] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:13:59 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:01.030395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9d7d7ef6-f4ee-4525-9b2c-bfbd136ec39c tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595aea670>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:01.060700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9d7d7ef6-f4ee-4525-9b2c-bfbd136ec39c tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.034591 Jun 21 19:14:01.061287 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 487/967] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:14:01 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:02.070152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:02.070899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:02.074727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bb8da710-7f1f-4b9a-9d94-b991bf66dcd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595953dc0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:02.108154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bb8da710-7f1f-4b9a-9d94-b991bf66dcd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.039309 Jun 21 19:14:02.108708 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 481/968] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:14:02 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:03.116814 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:03.118175 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:03.122838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e0bfb220-218c-41b7-92fd-55cefcfb9b3f tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35959b64c0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:03.152823 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e0bfb220-218c-41b7-92fd-55cefcfb9b3f tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 288 microversion: 2.1 time: 0.036808 Jun 21 19:14:03.153428 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 488/969] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:14:03 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:03.163834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-88d3cbf9-e9fa-4b26-aa3a-da5bbc46ec51 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35957e5310>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:03.220388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-88d3cbf9-e9fa-4b26-aa3a-da5bbc46ec51 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 202 len: 0 microversion: 2.1 time: 0.060732 Jun 21 19:14:03.221028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 482/970] 10.222.0.70 () {58 vars in 1253 bytes} [Tue Jun 21 19:14:03 2022] DELETE /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:14:03.229222 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-bed21864-8a37-4ebf-b386-c2bb71388731 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595962430>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:03.259332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-bed21864-8a37-4ebf-b386-c2bb71388731 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 200 len: 287 microversion: 2.1 time: 0.033907 Jun 21 19:14:03.259884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 489/971] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:14:03 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:04.271516 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1c5b6d5e-8aff-4ed6-92f9-3341ec028fd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595979ca0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:04.297204 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-1c5b6d5e-8aff-4ed6-92f9-3341ec028fd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] HTTP exception thrown: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1c5b6d5e-8aff-4ed6-92f9-3341ec028fd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Request method failure captured: Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 HTTP/1.1 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishh0BD5EOjulEUJwR-TSIFjVra53ofVLLbaCw6bhH0tjZEphLgMbFc6wSPtyTWj9KUUtdYChYSD_lD3cHuAOOWIU8dROT-KshfuEr8i_lOpp1a02xN87opWTSJARfkuF1U1UVsiUdmEKmmdwP5Nmvl1xJXg1qNcmvB5kQJHfL-FgQc4 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:04.300312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}] Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: c908bcb3869442b2bd8c630ae1e5d9c1 Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '36512ce8-031f-4175-a6f7-888e137bbe19'} Jun 21 19:14:04.302041 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. (HTTP 404) (Request-ID: req-42209682-6add-49bb-b830-ccb6dfe8020a) Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.303171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:04.304611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 19:14:04.306153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1c5b6d5e-8aff-4ed6-92f9-3341ec028fd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Returning 404 to user: Snapshot 36512ce8-031f-4175-a6f7-888e137bbe19 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1c5b6d5e-8aff-4ed6-92f9-3341ec028fd0 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19" status: 404 len: 111 microversion: 2.1 time: 0.034618 Jun 21 19:14:04.307696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 483/972] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 19:14:04 2022] GET /compute/v2.1/os-snapshots/36512ce8-031f-4175-a6f7-888e137bbe19 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:04.310971 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ace6d112-a265-4937-884f-1c1b6a3f41bd tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35957ae5e0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:04.372913 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ace6d112-a265-4937-884f-1c1b6a3f41bd tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 202 len: 0 microversion: 2.1 time: 0.066202 Jun 21 19:14:04.373507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 490/973] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:14:04 2022] DELETE /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:14:04.381933 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-428f1077-be22-4e23-b2b9-2ce4950be0b4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35957bd040>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:04.429285 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-428f1077-be22-4e23-b2b9-2ce4950be0b4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 200 len: 345 microversion: 2.1 time: 0.051042 Jun 21 19:14:04.429857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 484/974] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:14:04 2022] GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:05.442691 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1346379f-f703-48be-b970-808ad989938b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f35959b6d30>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:05.469765 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-1346379f-f703-48be-b970-808ad989938b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] HTTP exception thrown: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1346379f-f703-48be-b970-808ad989938b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Request method failure captured: Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 HTTP/1.1 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishh0BD5EOjulEUJwR-TSIFjVra53ofVLLbaCw6bhH0tjZEphLgMbFc6wSPtyTWj9KUUtdYChYSD_lD3cHuAOOWIU8dROT-KshfuEr8i_lOpp1a02xN87opWTSJARfkuF1U1UVsiUdmEKmmdwP5Nmvl1xJXg1qNcmvB5kQJHfL-FgQc4 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:05.471761 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}] Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: c908bcb3869442b2bd8c630ae1e5d9c1 Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '52ccd08c-f602-40ea-81f2-1d91d9f0f537'} Jun 21 19:14:05.473230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. (HTTP 404) (Request-ID: req-f6a7c790-ed19-4185-808d-b5e8e747c283) Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.474083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:05.475459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 19:14:05.477816 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1346379f-f703-48be-b970-808ad989938b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Returning 404 to user: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1346379f-f703-48be-b970-808ad989938b tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 404 len: 109 microversion: 2.1 time: 0.035446 Jun 21 19:14:05.480011 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 491/975] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:14:05 2022] GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:05.488297 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2b64dfd-3d67-4ab7-a6f0-1f8a16cd02ce tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f359594aaf0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:05.517015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c2b64dfd-3d67-4ab7-a6f0-1f8a16cd02ce tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] HTTP exception thrown: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2b64dfd-3d67-4ab7-a6f0-1f8a16cd02ce tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Request method failure captured: Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 HTTP/1.1 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishh0BD5EOjulEUJwR-TSIFjVra53ofVLLbaCw6bhH0tjZEphLgMbFc6wSPtyTWj9KUUtdYChYSD_lD3cHuAOOWIU8dROT-KshfuEr8i_lOpp1a02xN87opWTSJARfkuF1U1UVsiUdmEKmmdwP5Nmvl1xJXg1qNcmvB5kQJHfL-FgQc4 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:05.519504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}] Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: c908bcb3869442b2bd8c630ae1e5d9c1 Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '52ccd08c-f602-40ea-81f2-1d91d9f0f537'} Jun 21 19:14:05.521258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. (HTTP 404) (Request-ID: req-acba5c41-6449-4e64-842b-4b7656d9d4b3) Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.522411 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:05.523946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 19:14:05.525658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2b64dfd-3d67-4ab7-a6f0-1f8a16cd02ce tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Returning 404 to user: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c2b64dfd-3d67-4ab7-a6f0-1f8a16cd02ce tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 404 len: 109 microversion: 2.1 time: 0.036898 Jun 21 19:14:05.527081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 485/976] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:14:05 2022] DELETE /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:05.529223 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-84d8be6c-0ae5-4f56-a2b3-adad474f3fb4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Calling method '.version_select at 0x7f3595aea8b0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:05.557012 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-84d8be6c-0ae5-4f56-a2b3-adad474f3fb4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] HTTP exception thrown: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-84d8be6c-0ae5-4f56-a2b3-adad474f3fb4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Request method failure captured: Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 HTTP/1.1 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishh0BD5EOjulEUJwR-TSIFjVra53ofVLLbaCw6bhH0tjZEphLgMbFc6wSPtyTWj9KUUtdYChYSD_lD3cHuAOOWIU8dROT-KshfuEr8i_lOpp1a02xN87opWTSJARfkuF1U1UVsiUdmEKmmdwP5Nmvl1xJXg1qNcmvB5kQJHfL-FgQc4 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:05.559050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cfb06fcf112450ba272a9254822bf56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cfb06fcf112450ba272a9254822bf56"}]}] Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 6cfb06fcf112450ba272a9254822bf56 Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995350753 Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: c908bcb3869442b2bd8c630ae1e5d9c1 Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995350753-project Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '52ccd08c-f602-40ea-81f2-1d91d9f0f537'} Jun 21 19:14:05.561448 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. (HTTP 404) (Request-ID: req-f0629bff-16a9-4877-b893-ca987223152f) Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.563033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:05.565191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 19:14:05.567075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-84d8be6c-0ae5-4f56-a2b3-adad474f3fb4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] Returning 404 to user: Volume 52ccd08c-f602-40ea-81f2-1d91d9f0f537 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-84d8be6c-0ae5-4f56-a2b3-adad474f3fb4 tempest-VolumesSnapshotsTestJSON-995350753 tempest-VolumesSnapshotsTestJSON-995350753-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537" status: 404 len: 109 microversion: 2.1 time: 0.035018 Jun 21 19:14:05.569695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 492/977] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:14:05 2022] GET /compute/v2.1/os-volumes/52ccd08c-f602-40ea-81f2-1d91d9f0f537 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:21.885970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:21.886514 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:21.890717 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-cd0ed919-d781-4c75-8821-72b1d6615405 req-8ac1a1c9-42fa-4370-91ef-663c3c342a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675894b3-7569-4b40-9ab8-f43a4d9d5450", "tag": "1662bf13-bcce-4c24-bb2c-c08c77cc2065"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:21.896232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:21.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:21.897909 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:21.898350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:21.900368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-cd0ed919-d781-4c75-8821-72b1d6615405 req-8ac1a1c9-42fa-4370-91ef-663c3c342a9b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:21.901059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-cd0ed919-d781-4c75-8821-72b1d6615405 req-8ac1a1c9-42fa-4370-91ef-663c3c342a9b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:21.912055 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-cd0ed919-d781-4c75-8821-72b1d6615405 req-8ac1a1c9-42fa-4370-91ef-663c3c342a9b service nova] Creating event network-changed:1662bf13-bcce-4c24-bb2c-c08c77cc2065 for instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 on hv-cinder-84630 Jun 21 19:14:21.919287 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-cd0ed919-d781-4c75-8821-72b1d6615405 req-8ac1a1c9-42fa-4370-91ef-663c3c342a9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Jun 21 19:14:21.920208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 493/978] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:14:21.925899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:14:22.034111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1930faf7-9da1-461f-8858-ca2116d3da9f tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "DELETE /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 204 len: 0 microversion: 2.1 time: 0.152466 Jun 21 19:14:22.038282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 486/979] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:14:21 2022] DELETE /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:14:22.046673 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:22.047385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:22.056650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:22.057370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:22.058537 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:22.059146 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:22.225006 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:22.233281 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e2aa7112-9651-4d45-bdbd-b26e77ee215b tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1579 microversion: 2.1 time: 0.193058 Jun 21 19:14:22.233917 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 494/980] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:22 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:14:23.254640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:23.256067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:23.265567 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:23.266339 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:23.267099 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:23.267620 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:23.444301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:23.452737 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1e28ccfa-0648-4c37-9eed-542a18cdcefc tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1579 microversion: 2.1 time: 0.202741 Jun 21 19:14:23.453332 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 487/981] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:23 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1579 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:24.470132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:24.471379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:24.477938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:24.478454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:24.479172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:24.479449 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:24.575599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:24.577912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-662e1bc3-d64f-4ff5-8d73-6ed7e587c24f req-375211c2-4914-4099-8612-8852bbb68673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675894b3-7569-4b40-9ab8-f43a4d9d5450", "name": "network-vif-deleted", "tag": "1662bf13-bcce-4c24-bb2c-c08c77cc2065"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:24.583455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ba976994-3edc-4baa-94c6-ff67a0659a3d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 200 len: 1392 microversion: 2.1 time: 0.117512 Jun 21 19:14:24.593800 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 495/982] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:24 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 1392 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:24.597879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-662e1bc3-d64f-4ff5-8d73-6ed7e587c24f req-375211c2-4914-4099-8612-8852bbb68673 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:24.598585 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-662e1bc3-d64f-4ff5-8d73-6ed7e587c24f req-375211c2-4914-4099-8612-8852bbb68673 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:24.610667 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-662e1bc3-d64f-4ff5-8d73-6ed7e587c24f req-375211c2-4914-4099-8612-8852bbb68673 service nova] Creating event network-vif-deleted:1662bf13-bcce-4c24-bb2c-c08c77cc2065 for instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 on hv-cinder-84630 Jun 21 19:14:24.616029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-662e1bc3-d64f-4ff5-8d73-6ed7e587c24f req-375211c2-4914-4099-8612-8852bbb68673 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042674 Jun 21 19:14:24.616637 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 488/983] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:25.601713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:25.602332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 675894b3-7569-4b40-9ab8-f43a4d9d5450] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:25.608833 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:25.609334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:25.610109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:25.610548 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:25.625243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] HTTP exception thrown: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Request method failure captured: Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 HTTP/1.1 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishZDKkR4HPaezv66AL7gQn-wZWzsR0JZZWPkOxyoZApjGWnCtI-dDujO0xTVMVoYNnXj6w7MPMLFNzXZOdgH5GGqvz3MYHQwIM3ALNuuR9VlbnUcR6qHTOT8DARdAvbQ9Q92-51eQqlRcMxprm3O7LWCbIVNE9D4ljCOawL4r3wSZ7Y Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:25.626872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}] Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 569256e6d1d1418eafb5ff2ed8909926 Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. Jun 21 19:14:25.628212 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '675894b3-7569-4b40-9ab8-f43a4d9d5450'} Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:25.628973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. Jun 21 19:14:25.630247 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:25.631374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Returning 404 to user: Instance 675894b3-7569-4b40-9ab8-f43a4d9d5450 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:25.631374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3b6bb924-aac1-4d00-ab10-344119a717f1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450" status: 404 len: 111 microversion: 2.1 time: 0.030497 Jun 21 19:14:25.631374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 496/984] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:25 2022] GET /compute/v2.1/servers/675894b3-7569-4b40-9ab8-f43a4d9d5450 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:28.802568 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:28.803402 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-965de2dd-391d-401b-b26c-86f7039920b5 req-fc6a95c2-5213-4d19-a326-3b6d48d4818a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f8ce3-ce32-4edb-9ab3-b10bb2efc36c", "tag": "111addab-171e-4b55-ac0c-859ba5bac005"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:28.803885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:28.814884 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:28.815334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:28.816104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:28.816556 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:28.820396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-965de2dd-391d-401b-b26c-86f7039920b5 req-fc6a95c2-5213-4d19-a326-3b6d48d4818a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:28.821069 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-965de2dd-391d-401b-b26c-86f7039920b5 req-fc6a95c2-5213-4d19-a326-3b6d48d4818a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:28.835390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-965de2dd-391d-401b-b26c-86f7039920b5 req-fc6a95c2-5213-4d19-a326-3b6d48d4818a service nova] Creating event network-changed:111addab-171e-4b55-ac0c-859ba5bac005 for instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c on hv-cinder-84630 Jun 21 19:14:28.847424 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-965de2dd-391d-401b-b26c-86f7039920b5 req-fc6a95c2-5213-4d19-a326-3b6d48d4818a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048410 Jun 21 19:14:28.849141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 497/985] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:28.861886 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:14:28.987196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-40057dc6-11c8-4b0b-a86d-699c92a6e245 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "DELETE /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 204 len: 0 microversion: 2.1 time: 0.191594 Jun 21 19:14:28.988327 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 489/986] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:14:28 2022] DELETE /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:14:28.998757 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:28.999648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:29.006659 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:29.007322 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:29.008252 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:29.009129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:29.217939 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:29.233333 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e412f530-0142-4024-ad04-79f38c68b578 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1580 microversion: 2.1 time: 0.240533 Jun 21 19:14:29.234326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 498/987] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:28 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1580 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:30.252011 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:30.252701 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:30.259278 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:30.259720 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:30.260504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:30.260930 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:30.477302 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:30.485365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9d8d0f34-3a0a-46d5-ae5c-03a53336323e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1461 microversion: 2.1 time: 0.237081 Jun 21 19:14:30.494318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 490/988] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:30 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:30.947155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-24d43134-a457-48b6-926e-e071840864a7 req-9c1f079a-bdea-40d7-9632-96619a6567b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8ce3-ce32-4edb-9ab3-b10bb2efc36c", "name": "network-vif-deleted", "tag": "111addab-171e-4b55-ac0c-859ba5bac005"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:30.956518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-24d43134-a457-48b6-926e-e071840864a7 req-9c1f079a-bdea-40d7-9632-96619a6567b5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:30.956966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-24d43134-a457-48b6-926e-e071840864a7 req-9c1f079a-bdea-40d7-9632-96619a6567b5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:30.968298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-24d43134-a457-48b6-926e-e071840864a7 req-9c1f079a-bdea-40d7-9632-96619a6567b5 service nova] Creating event network-vif-deleted:111addab-171e-4b55-ac0c-859ba5bac005 for instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c on hv-cinder-84630 Jun 21 19:14:30.973865 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-24d43134-a457-48b6-926e-e071840864a7 req-9c1f079a-bdea-40d7-9632-96619a6567b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 Jun 21 19:14:30.974479 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 499/989] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:31.501844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:31.502401 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:31.508999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:31.509483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:31.510249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:31.510709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:31.576695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:31.584214 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6a72dc3d-498e-4c9a-8fc0-579e4191270a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1226 microversion: 2.1 time: 0.086361 Jun 21 19:14:31.584777 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 491/990] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:31 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:32.602707 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:32.603311 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:32.610453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:32.610901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:32.611677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:32.612792 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:32.679191 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:32.687601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8798e703-3b36-41b6-ba78-e3686a21a271 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1226 microversion: 2.1 time: 0.089726 Jun 21 19:14:32.688170 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 500/991] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:32 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:33.705043 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:33.705713 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:33.712425 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:33.712871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:33.713694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:33.714126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:33.776301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:33.784308 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6c925fc9-d466-4184-92e9-969970b0379d tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1226 microversion: 2.1 time: 0.083040 Jun 21 19:14:33.785007 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 492/992] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:33 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:14:34.804875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:34.805519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:34.812616 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:34.813066 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:34.813869 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:34.814310 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:34.875443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:34.882879 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1e86c3f6-9d5f-460f-b3cd-c3dae6668e6e tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1226 microversion: 2.1 time: 0.081825 Jun 21 19:14:34.883429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 501/993] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:34 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:35.304170 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:35.305216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:35.311755 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.312225 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.312972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.313439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.343156 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4fd34ee0-b7f3-4067-9676-50e16a56f62d tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042925 Jun 21 19:14:35.343760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 493/994] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 19:14:35 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:35.407815 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:35.408320 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:35.414412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.414802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.415573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.416017 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.442411 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:14:35.519166 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ab2cf541-40a2-4ff5-8c4a-4ef38facd317 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 204 len: 0 microversion: 2.20 time: 0.114865 Jun 21 19:14:35.519753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 502/995] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 19:14:35 2022] DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 19:14:35.529141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:35.530112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:35.536272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.536782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.537701 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.538178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.674889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:35.683107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:35.684603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:35.685805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-42b5e241-aaf3-4db2-a013-e9be4dbd3f3a tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.161524 Jun 21 19:14:35.686358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 494/996] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:35 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 19:14:35.900267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:35.901122 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:35.907643 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.908093 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.908868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.909429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.940961 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:35.941453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:35.941909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:35.986510 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:35.994407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-efa34b30-1444-4da5-976e-19f393723c9a tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1231 microversion: 2.1 time: 0.098301 Jun 21 19:14:35.994967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 503/997] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:35 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:36.704894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:36.705548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:36.712036 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:36.712490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:36.713280 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:36.713721 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:36.841213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:36.849039 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:36.850548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:36.851691 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6b552696-76b9-4167-90a9-b893ce95fd18 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.150740 Jun 21 19:14:36.852236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 495/998] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:36 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:37.011858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:37.012390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:37.019069 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:37.019517 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:37.020284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:37.020722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:37.050941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:37.051391 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:37.051843 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:37.095584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:37.103057 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8142bff6-3a97-4f8b-8635-27e808f843fb tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1231 microversion: 2.1 time: 0.095251 Jun 21 19:14:37.103634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 504/999] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:37 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:37.870112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:37.870739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:37.877560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:37.878016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:37.878800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:37.879240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:38.009102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:38.017553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:38.019044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:38.020196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ddbf4af2-e3f6-4883-874d-a1c0d8600bdf tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.154128 Jun 21 19:14:38.020743 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 496/1000] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:37 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:38.119766 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:38.120385 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:38.127438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:38.127890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:38.128658 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:38.129108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:38.163545 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:38.164045 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:38.164648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:38.206143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:38.213753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1763cfab-c989-4618-8107-360344bbeaf1 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1231 microversion: 2.1 time: 0.097800 Jun 21 19:14:38.214282 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 505/1001] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:38 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:39.039002 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:39.039615 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:39.046300 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:39.046757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:39.047522 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:39.047965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:39.180237 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:39.188669 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:39.190213 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:39.191376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0a2271f3-feb4-47b9-8633-bbb34d476339 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.156398 Jun 21 19:14:39.191932 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 497/1002] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:39 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:39.231008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:39.231629 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:39.238470 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:39.238967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:39.239753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:39.240197 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:39.270941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:39.271395 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:39.271855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:39.313023 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:39.320978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f6ed23c3-fde7-4422-9ed5-77e7264256df tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1231 microversion: 2.1 time: 0.094289 Jun 21 19:14:39.321583 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 506/1003] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:39 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:14:40.211747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:40.212362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:40.219714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:40.220166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:40.220951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:40.221426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:40.341298 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:40.342309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:40.348343 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:40.348793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:40.349724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:40.350144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:40.364577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:40.373149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:40.374632 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:40.375790 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-560d0926-1701-4a95-9d8e-42790d0ccf1e tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.169429 Jun 21 19:14:40.376560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 498/1004] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:40 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:40.385930 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:40.386978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:40.387437 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lazy-loading 'fault' on Instance uuid 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:40.432796 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569256e6d1d1418eafb5ff2ed8909926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccd9a91f96a4a698f5d9d7028216a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:40.440852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d9e74bd6-b68b-499e-a937-186e4e10eba9 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 200 len: 1231 microversion: 2.1 time: 0.104991 Jun 21 19:14:40.441465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 507/1005] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:40 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:14:41.397854 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:41.398457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:41.412013 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:41.412638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:41.413548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:41.414082 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:41.458168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:41.458974 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:41.465981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:41.466521 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:41.467355 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:41.467855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:41.484824 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] HTTP exception thrown: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Request method failure captured: Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c HTTP/1.1 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishZDKkR4HPaezv66AL7gQn-wZWzsR0JZZWPkOxyoZApjGWnCtI-dDujO0xTVMVoYNnXj6w7MPMLFNzXZOdgH5GGqvz3MYHQwIM3ALNuuR9VlbnUcR6qHTOT8DARdAvbQ9Q92-51eQqlRcMxprm3O7LWCbIVNE9D4ljCOawL4r3wSZ7Y Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:41.486695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}] Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 569256e6d1d1418eafb5ff2ed8909926 Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. Jun 21 19:14:41.488168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '437f8ce3-ce32-4edb-9ab3-b10bb2efc36c'} Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:41.489585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. Jun 21 19:14:41.490955 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:41.492731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Returning 404 to user: Instance 437f8ce3-ce32-4edb-9ab3-b10bb2efc36c could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:41.492731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3de1aa82-7b8b-4124-abbb-fd7d1ea42f33 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c" status: 404 len: 111 microversion: 2.1 time: 0.033820 Jun 21 19:14:41.492731 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 508/1006] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:41 2022] GET /compute/v2.1/servers/437f8ce3-ce32-4edb-9ab3-b10bb2efc36c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:41.637244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:41.641404 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:41.651545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:41.654277 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:41.656104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-3cad141a-5c48-43da-a149-ebeff795a32f tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1724 microversion: 2.20 time: 0.262157 Jun 21 19:14:41.656763 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 499/1007] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:41 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:42.198409 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:42.198907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:42.205878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.206322 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.207090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.207518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.221837 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] HTTP exception thrown: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Request method failure captured: Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 HTTP/1.1 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishZDKkR4HPaezv66AL7gQn-wZWzsR0JZZWPkOxyoZApjGWnCtI-dDujO0xTVMVoYNnXj6w7MPMLFNzXZOdgH5GGqvz3MYHQwIM3ALNuuR9VlbnUcR6qHTOT8DARdAvbQ9Q92-51eQqlRcMxprm3O7LWCbIVNE9D4ljCOawL4r3wSZ7Y Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:42.223396 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}] Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 569256e6d1d1418eafb5ff2ed8909926 Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.224904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '00a160e9-aeee-4070-b1e2-b21fe7d01849'} Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:42.225858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.227383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.228888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Returning 404 to user: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:42.228888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2dfdfc3e-cadd-4ef0-931b-f442b986f386 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "DELETE /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 404 len: 111 microversion: 2.1 time: 0.030381 Jun 21 19:14:42.228888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 509/1008] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:14:42 2022] DELETE /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:42.238406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:42.239023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] [instance: 00a160e9-aeee-4070-b1e2-b21fe7d01849] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:42.245977 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.246593 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.247390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.247836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.262842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] HTTP exception thrown: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Request method failure captured: Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 HTTP/1.1 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishZDKkR4HPaezv66AL7gQn-wZWzsR0JZZWPkOxyoZApjGWnCtI-dDujO0xTVMVoYNnXj6w7MPMLFNzXZOdgH5GGqvz3MYHQwIM3ALNuuR9VlbnUcR6qHTOT8DARdAvbQ9Q92-51eQqlRcMxprm3O7LWCbIVNE9D4ljCOawL4r3wSZ7Y Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:42.264552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cccd9a91f96a4a698f5d9d7028216a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cccd9a91f96a4a698f5d9d7028216a35"}]}] Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: cccd9a91f96a4a698f5d9d7028216a35 Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestVolumeBootPattern-528418932 Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 569256e6d1d1418eafb5ff2ed8909926 Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestVolumeBootPattern-528418932-project Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.266196 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '00a160e9-aeee-4070-b1e2-b21fe7d01849'} Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:42.267005 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. Jun 21 19:14:42.268223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:42.269342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Returning 404 to user: Instance 00a160e9-aeee-4070-b1e2-b21fe7d01849 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:42.269342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8a5b99ab-5b7c-4031-9bd4-edcd3f1ca0aa tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849" status: 404 len: 111 microversion: 2.1 time: 0.031838 Jun 21 19:14:42.269342 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 500/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:14:42 2022] GET /compute/v2.1/servers/00a160e9-aeee-4070-b1e2-b21fe7d01849 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:42.470342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-512a4a7c-ceab-49c5-9d4c-f5ef5fab4e47 req-4c519162-d58b-4637-ac4e-4530d56aefc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e", "name": "network-vif-deleted", "tag": "ec6dcac6-fcdd-4818-9557-b9855d7158e1"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:42.480903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-512a4a7c-ceab-49c5-9d4c-f5ef5fab4e47 req-4c519162-d58b-4637-ac4e-4530d56aefc0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.481774 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-512a4a7c-ceab-49c5-9d4c-f5ef5fab4e47 req-4c519162-d58b-4637-ac4e-4530d56aefc0 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.486702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:14:42.496657 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-512a4a7c-ceab-49c5-9d4c-f5ef5fab4e47 req-4c519162-d58b-4637-ac4e-4530d56aefc0 service nova] Creating event network-vif-deleted:ec6dcac6-fcdd-4818-9557-b9855d7158e1 for instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e on hv-cinder-84630 Jun 21 19:14:42.504568 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-512a4a7c-ceab-49c5-9d4c-f5ef5fab4e47 req-4c519162-d58b-4637-ac4e-4530d56aefc0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039490 Jun 21 19:14:42.505696 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 510/1010] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:14:42.675924 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:42.677217 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:42.686260 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.686900 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.687864 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.688615 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.733773 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:42.734240 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:42.735031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lazy-loading 'fault' on Instance uuid c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:14:42.782932 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:42.791935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:42.793949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6ce650c0ae6494ab895644347bbb5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e052c1c726e48ea98ee7b21c3cd55d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:14:42.795115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-55db7c02-97a8-456b-a978-c6a12def41a7 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 200 len: 1371 microversion: 2.20 time: 0.123672 Jun 21 19:14:42.797133 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 501/1011] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:42 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 19:14:43.573903 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-91be77a3-551f-4ab4-8bc4-2289b476c730 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] Calling method '.version_select at 0x7f35957eb550>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:43.593020 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-91be77a3-551f-4ab4-8bc4-2289b476c730 tempest-TestVolumeBootPattern-528418932 tempest-TestVolumeBootPattern-528418932-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006781389" status: 202 len: 0 microversion: 2.1 time: 0.026805 Jun 21 19:14:43.593577 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 511/1012] 10.222.0.70 () {58 vars in 1262 bytes} [Tue Jun 21 19:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006781389 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:14:43.814019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:43.814667 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:43.821603 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:43.822055 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:43.822814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:43.823249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:43.837472 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e HTTP/1.1 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:43.839035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:43.841463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e'} Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:43.842324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:43.843786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:43.845229 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:43.845229 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8d7c11dc-33d7-4d57-8bb5-9b75467f1cb1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 404 len: 111 microversion: 2.20 time: 0.031071 Jun 21 19:14:43.845229 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 502/1013] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:43 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:43.850279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da2af062-0de1-45a3-bebf-04319815aaa0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '.version_select at 0x7f35959b4d30>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:43.868436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da2af062-0de1-45a3-bebf-04319815aaa0 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022877665" status: 204 len: 0 microversion: 2.20 time: 0.021930 Jun 21 19:14:43.869014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 512/1014] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jun 21 19:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022877665 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 19:14:48.834080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:48.834726 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:48.841564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:48.842158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:48.843162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:48.843696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:48.858263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e HTTP/1.1 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:48.859935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.861629 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e'} Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:48.866874 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.868465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.869945 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:48.869945 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c087ee74-3cb2-4bf9-810d-d435b57d3fa1 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 404 len: 111 microversion: 2.20 time: 0.031558 Jun 21 19:14:48.869945 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 503/1015] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 19:14:48 2022] DELETE /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:48.870198 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:48.871549 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:48.878566 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:48.879100 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:48.879861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:48.880295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:48.894295 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e HTTP/1.1 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:48.896000 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.897785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e'} Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:48.901664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. Jun 21 19:14:48.903221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:48.904965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:48.904965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6538e375-3af8-42a1-a20b-51ede1c992cc tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e" status: 404 len: 111 microversion: 2.20 time: 0.031175 Jun 21 19:14:48.904965 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 513/1016] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:48 2022] GET /compute/v2.1/servers/c7cae98a-f4c4-46cc-b4c4-f8be9b64eb2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 19:14:50.072661 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:50.073358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:50.080429 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:50.080878 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:50.081747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:50.082181 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:50.097727 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 HTTP/1.1 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:50.099367 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.101200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '0f90611c-b33b-4c4d-9a8d-95d86d8104c8'} Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:50.102489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.104488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.107388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:50.107388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-aef1cb86-0c70-49e6-9afe-c6466f11ed20 tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 404 len: 111 microversion: 2.20 time: 0.032035 Jun 21 19:14:50.107388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 504/1017] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 19:14:50 2022] DELETE /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:50.109699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:50.110330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] [instance: 0f90611c-b33b-4c4d-9a8d-95d86d8104c8] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:14:50.117007 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:50.121663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:50.122608 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:14:50.123307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:14:50.139938 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] HTTP exception thrown: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Request method failure captured: Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 HTTP/1.1 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishXcFmm6nCggqaw7rXX_3r1EJ51NaYt_mIFwRN74DtjgGDmNR_Pme8lW8zX4-kIv4_ZZm10kZBEvRZwge0L0gUIA7chpxGsmYraQFbkIfqjqGJH8wSgczEqmjAxZDjKXGVwrmoEYQuuj__hD_HnOJ51vIk7wWXdsQecmMHplD1uaRqg Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:50.141621 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e052c1c726e48ea98ee7b21c3cd55d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e052c1c726e48ea98ee7b21c3cd55d7"}]}] Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 0e052c1c726e48ea98ee7b21c3cd55d7 Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-850696186 Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: b6ce650c0ae6494ab895644347bbb5b7 Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeShelveTestJSON-850696186-project Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.143386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '0f90611c-b33b-4c4d-9a8d-95d86d8104c8'} Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:50.144325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. Jun 21 19:14:50.146267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:50.147771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] Returning 404 to user: Instance 0f90611c-b33b-4c4d-9a8d-95d86d8104c8 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:50.147771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1053e1cc-2320-47ef-afba-26479d272eef tempest-AttachVolumeShelveTestJSON-850696186 tempest-AttachVolumeShelveTestJSON-850696186-project] 10.222.0.70 "GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8" status: 404 len: 111 microversion: 2.20 time: 0.038870 Jun 21 19:14:50.147771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 514/1018] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 19:14:50 2022] GET /compute/v2.1/servers/0f90611c-b33b-4c4d-9a8d-95d86d8104c8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:54.857414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c61c9c70-9cdb-4593-923d-3d98393b260e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Action: 'create', calling method: .version_select at 0x7f35958d9f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1056382264", "metadata": {"Type": "work"}}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c61c9c70-9cdb-4593-923d-3d98393b260e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 122 Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:54.879948 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1056382264", "metadata": {"Type": "work"}}} Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: Jun 21 19:14:54.881719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1056382264', 'metadata': {'Type': 'work'}}}} Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise error Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:54.882725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 19:14:54.884413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 19:14:54.885813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 19:14:54.885813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.885813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c61c9c70-9cdb-4593-923d-3d98393b260e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:54.885813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c61c9c70-9cdb-4593-923d-3d98393b260e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149725 Jun 21 19:14:54.885813 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 505/1019] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 19:14:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:54.892030 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b879e56e-65d5-47ee-86e6-0dd80cf9ab1b tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Action: 'create', calling method: .version_select at 0x7f35959129d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2050057341", "metadata": {"Type": "work"}}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b879e56e-65d5-47ee-86e6-0dd80cf9ab1b tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 120 Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:54.895304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2050057341", "metadata": {"Type": "work"}}} Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:14:54.896897 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2050057341', 'metadata': {'Type': 'work'}}}} Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise error Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi '0' Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:54.897924 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 19:14:54.899656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 19:14:54.901157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 19:14:54.901157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.901157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b879e56e-65d5-47ee-86e6-0dd80cf9ab1b tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:54.901157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b879e56e-65d5-47ee-86e6-0dd80cf9ab1b tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008615 Jun 21 19:14:54.901157 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 515/1020] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 19:14:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:54.906578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1cd66582-a404-43de-bdba-89e1481e6a90 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Action: 'create', calling method: .version_select at 0x7f35957e5ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1687838025", "metadata": {"Type": "work"}}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1cd66582-a404-43de-bdba-89e1481e6a90 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 119 Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:54.909079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1687838025", "metadata": {"Type": "work"}}} Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: Jun 21 19:14:54.910846 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1687838025', 'metadata': {'Type': 'work'}}}} Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise error Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi '' Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:54.911829 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 19:14:54.913668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 19:14:54.914931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 19:14:54.914931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.914931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1cd66582-a404-43de-bdba-89e1481e6a90 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:54.914931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1cd66582-a404-43de-bdba-89e1481e6a90 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007821 Jun 21 19:14:54.914931 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 506/1021] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 19:14:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:14:54.921923 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7d2aec2-8ac7-4718-9480-5a92b0392cfa tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Calling method '.version_select at 0x7f3595b3e550>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:54.951944 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-e7d2aec2-8ac7-4718-9480-5a92b0392cfa tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] HTTP exception thrown: Volume tempest-invalid-810948340 could not be found. Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7d2aec2-8ac7-4718-9480-5a92b0392cfa tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-810948340 HTTP/1.1 Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:54.953905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Volume tempest-invalid-810948340 could not be found. Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'tempest-invalid-810948340'} Jun 21 19:14:54.955574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-810948340 could not be found. (HTTP 404) (Request-ID: req-27fbe5f3-95f5-44f2-a278-242cf95d4e85) Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.956504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:54.957811 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-810948340 could not be found. Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:54.959248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-810948340 could not be found. Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-810948340 could not be found. Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e7d2aec2-8ac7-4718-9480-5a92b0392cfa tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 404 to user: Volume tempest-invalid-810948340 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e7d2aec2-8ac7-4718-9480-5a92b0392cfa tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-810948340" status: 404 len: 98 microversion: 2.1 time: 0.037956 Jun 21 19:14:54.960638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 516/1022] 10.222.0.70 () {58 vars in 1214 bytes} [Tue Jun 21 19:14:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-810948340 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 19:14:54.966384 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5fd8526e-8b27-4257-a795-4957c647925e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003767 Jun 21 19:14:54.966879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 507/1023] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jun 21 19:14:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 19:14:54.975226 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-33592dc5-c386-4705-810c-1907a211110e tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003789 Jun 21 19:14:54.975767 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 517/1024] 10.222.0.70 () {58 vars in 1136 bytes} [Tue Jun 21 19:14:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 19:14:54.984587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-487e5f9f-1757-4044-bc76-870eb1a29a63 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Calling method '.version_select at 0x7f35957e28b0>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:55.012627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-487e5f9f-1757-4044-bc76-870eb1a29a63 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] HTTP exception thrown: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-487e5f9f-1757-4044-bc76-870eb1a29a63 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/os-volumes/e901732b-051f-44e4-a80f-19f1024d3a06 HTTP/1.1 Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:14:55.014666 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'e901732b-051f-44e4-a80f-19f1024d3a06'} Jun 21 19:14:55.016283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. (HTTP 404) (Request-ID: req-21c59e1c-5d2e-476e-9897-dfbca967bc6f) Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.017441 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 19:14:55.018851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 19:14:55.020452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-487e5f9f-1757-4044-bc76-870eb1a29a63 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 404 to user: Volume e901732b-051f-44e4-a80f-19f1024d3a06 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-487e5f9f-1757-4044-bc76-870eb1a29a63 tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/e901732b-051f-44e4-a80f-19f1024d3a06" status: 404 len: 109 microversion: 2.1 time: 0.035164 Jun 21 19:14:55.021892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 508/1025] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:14:54 2022] DELETE /compute/v2.1/os-volumes/e901732b-051f-44e4-a80f-19f1024d3a06 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:14:55.025783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f71c9947-2490-4e4b-9d48-9987566baebf tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Calling method '.version_select at 0x7f3595b27af0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:14:55.053110 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-f71c9947-2490-4e4b-9d48-9987566baebf tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] HTTP exception thrown: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f71c9947-2490-4e4b-9d48-9987566baebf tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Request method failure captured: Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/os-volumes/19479a52-940d-4eee-8022-e7463972b347 HTTP/1.1 Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishiuaE4DtSs2FTvoVKptIXy4O4OfvQfrbjgOepuXBtzKZdlzzDJQeU0KdmLdfl2Rq_Szw7T3GxiYpIePrk1B2--ceNf4fPuQKTGhD_PqQtqmGwlSOd_WNa_jkqzb_ySGH8NOLYJs3AcamNDZi9UYYwdDg71nt9--zfkkpaNN1WP_cIc Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:14:55.055071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66c2d2a16f6f4242ae3318e99938706a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66c2d2a16f6f4242ae3318e99938706a"}]}] Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: 66c2d2a16f6f4242ae3318e99938706a Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-VolumesNegativeTest-1031458230 Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 3adac0acc8934cbfa491ff1ac94d67b5 Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-VolumesNegativeTest-1031458230-project Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '19479a52-940d-4eee-8022-e7463972b347'} Jun 21 19:14:55.056675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. (HTTP 404) (Request-ID: req-8823f9a1-f9cb-4c1f-8770-d6ebd895ff57) Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.057688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 19:14:55.059641 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 19:14:55.060806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-f71c9947-2490-4e4b-9d48-9987566baebf tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] Returning 404 to user: Volume 19479a52-940d-4eee-8022-e7463972b347 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-f71c9947-2490-4e4b-9d48-9987566baebf tempest-VolumesNegativeTest-1031458230 tempest-VolumesNegativeTest-1031458230-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/19479a52-940d-4eee-8022-e7463972b347" status: 404 len: 109 microversion: 2.1 time: 0.034594 Jun 21 19:14:55.062033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 518/1026] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 19:14:55 2022] GET /compute/v2.1/os-volumes/19479a52-940d-4eee-8022-e7463972b347 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:15:17.533457 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:17.534283 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=16 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:17.538733 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1987319027", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:17.589834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] validate_networks() for None {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:15:17.862479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:15:17.862907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:15:17.863380 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:15:17.863791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:15:17.864205 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:15:17.873584 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:17.874031 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:17.874830 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:17.875328 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:17.893049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Getting quotas for project 71b918ee36fa4888a6d708cfac6c2995. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:15:17.897152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Getting quotas for user 2bd39a103c444535b0bf643f45d91945 and project 71b918ee36fa4888a6d708cfac6c2995. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:15:17.908183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:15:17.910489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:15:17.957503 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fb733324-ab16-4d94-8c64-39b8bd52ac5a tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425057 Jun 21 19:15:17.958329 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 509/1027] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:15:17.966431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:17.967169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:17.971355 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-052de07c-e259-4842-bb50-5f71b2e4acc5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:17.972172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-052de07c-e259-4842-bb50-5f71b2e4acc5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:18.040153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-052de07c-e259-4842-bb50-5f71b2e4acc5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:18.050533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-052de07c-e259-4842-bb50-5f71b2e4acc5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1215 microversion: 2.1 time: 0.086069 Jun 21 19:15:18.051103 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 519/1028] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:17 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:19.068205 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:19.069273 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:19.078961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:19.078961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:19.078961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:19.082673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:19.171037 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:19.180291 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4db8a1cd-58b0-4a78-b071-f56dd092afb1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1275 microversion: 2.1 time: 0.116186 Jun 21 19:15:19.181310 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 510/1029] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:19 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:20.202012 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:20.203237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:20.210053 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:20.210513 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:20.211329 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:20.211804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:20.437622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:20.445413 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3ffc723a-7350-4499-a905-111f7b5c4d8f tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.250461 Jun 21 19:15:20.446083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 520/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:20 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:20.824915 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-68933cfc-2f4f-4c61-a03d-970bef0effc5 req-d95676e8-aee2-4cfd-aa5a-4935dd4c1ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3cace2-f508-4c4e-bde5-7568c541c9cb", "tag": "c6f101c2-0d66-4737-8b55-0b676cd19e98"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:20.839816 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-68933cfc-2f4f-4c61-a03d-970bef0effc5 req-d95676e8-aee2-4cfd-aa5a-4935dd4c1ed6 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:20.840866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-68933cfc-2f4f-4c61-a03d-970bef0effc5 req-d95676e8-aee2-4cfd-aa5a-4935dd4c1ed6 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:20.865583 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-68933cfc-2f4f-4c61-a03d-970bef0effc5 req-d95676e8-aee2-4cfd-aa5a-4935dd4c1ed6 service nova] Creating event network-changed:c6f101c2-0d66-4737-8b55-0b676cd19e98 for instance ac3cace2-f508-4c4e-bde5-7568c541c9cb on hv-cinder-84630 Jun 21 19:15:20.876183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-68933cfc-2f4f-4c61-a03d-970bef0effc5 req-d95676e8-aee2-4cfd-aa5a-4935dd4c1ed6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052370 Jun 21 19:15:20.877328 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 511/1031] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:21.463028 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:21.463640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:21.471149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:21.471600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:21.472370 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:21.472810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:21.599361 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:21.606830 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-c2de2021-6ab1-4863-8a12-c252b2ccebeb tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.147730 Jun 21 19:15:21.607399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 521/1032] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:21 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:22.625141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:22.625754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:22.632000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:22.632454 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:22.633251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:22.633692 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:22.760877 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:22.768365 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-eebb08fa-6a00-477b-a19e-cf29f28a3c42 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.148395 Jun 21 19:15:22.769115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 512/1033] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:22 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:23.784782 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:23.785442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:23.791824 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:23.792309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:23.793109 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:23.793555 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:24.001442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:24.008989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-50908da1-3d43-4afe-b6f9-2ce744dad7db tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.228008 Jun 21 19:15:24.009899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 522/1034] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:23 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:25.026494 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:25.027109 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:25.034164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:25.034617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:25.035381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:25.035814 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:25.161644 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:25.168997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a5822835-4383-446b-87c6-4f591f44ac48 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.146431 Jun 21 19:15:25.169605 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 513/1035] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:25 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:26.186087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:26.186737 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:26.193459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:26.194176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:26.194947 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:26.195394 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:26.567704 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:26.575636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-416519c7-05a1-4719-9462-a5f3a4b265f1 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.393543 Jun 21 19:15:26.576729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 523/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:26 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:27.592731 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:27.593395 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:27.599795 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:27.600244 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:27.601012 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:27.601483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:27.728421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:27.736487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e20db03f-97cf-48ea-806f-af9c1fbb4e26 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.148189 Jun 21 19:15:27.737038 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 514/1037] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:27 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:28.662515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:28.754520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:28.755139 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:28.757062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:28.757743 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:28.765790 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:28.766251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:28.767035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:28.767476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:28.851945 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-01e30f6e-6472-4777-8f7d-41f680e82ac5 req-74751d61-0352-4faf-b1d1-410a8ae04546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3cace2-f508-4c4e-bde5-7568c541c9cb", "name": "network-vif-plugged", "status": "completed", "tag": "c6f101c2-0d66-4737-8b55-0b676cd19e98"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:28.860512 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01e30f6e-6472-4777-8f7d-41f680e82ac5 req-74751d61-0352-4faf-b1d1-410a8ae04546 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:28.860959 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-01e30f6e-6472-4777-8f7d-41f680e82ac5 req-74751d61-0352-4faf-b1d1-410a8ae04546 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:28.871888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-01e30f6e-6472-4777-8f7d-41f680e82ac5 req-74751d61-0352-4faf-b1d1-410a8ae04546 service nova] Creating event network-vif-plugged:c6f101c2-0d66-4737-8b55-0b676cd19e98 for instance ac3cace2-f508-4c4e-bde5-7568c541c9cb on hv-cinder-84630 Jun 21 19:15:28.883690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-01e30f6e-6472-4777-8f7d-41f680e82ac5 req-74751d61-0352-4faf-b1d1-410a8ae04546 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226040 Jun 21 19:15:28.884825 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 524/1038] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:28.901907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:28.909434 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f059594b-69b7-442d-a3ea-de33e313263c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.158664 Jun 21 19:15:28.910006 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 515/1039] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:28 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:29.927039 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:29.927724 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:29.933894 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:29.934337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:29.935096 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:29.936059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:30.070270 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:30.078388 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2493a81a-38a8-4d73-8e8c-5c9c6c789c7d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1315 microversion: 2.1 time: 0.155971 Jun 21 19:15:30.078950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 525/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:29 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:31.094673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:31.095206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:31.101789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.102236 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.102992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.103424 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.230745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:31.238702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7ae2e99e-742e-4a6f-8692-3c43211763c5 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1464 microversion: 2.1 time: 0.147913 Jun 21 19:15:31.239265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 516/1041] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:31 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:31.278661 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:31.279664 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:31.286108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.286563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.287327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.287767 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.315083 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:15:31.390443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e4159e0e-ea84-44f8-a0a8-855c17b2d8c9 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 204 len: 0 microversion: 2.1 time: 0.115286 Jun 21 19:15:31.391014 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 526/1042] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:15:31 2022] DELETE /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:15:31.400534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:31.401185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:31.407969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.408420 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.409230 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:31.409663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:31.537960 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:31.546018 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-fb900b07-8add-4918-8ce1-3fed250bdaf8 tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1470 microversion: 2.1 time: 0.150685 Jun 21 19:15:31.546587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 517/1043] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:31 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:32.563716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:32.564420 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:32.571184 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:32.571639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:32.572436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:32.572880 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:32.709267 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:32.717495 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-961a8ce9-9c69-4076-ba30-d095b8d9c48c tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1470 microversion: 2.1 time: 0.157426 Jun 21 19:15:32.718078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 527/1044] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:32 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:33.353587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-d6835897-f6f8-49e1-8f43-41fc76b34c54 req-e89da360-b74e-47d5-be48-16720080191f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3cace2-f508-4c4e-bde5-7568c541c9cb", "name": "network-vif-deleted", "tag": "c6f101c2-0d66-4737-8b55-0b676cd19e98"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:33.365246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d6835897-f6f8-49e1-8f43-41fc76b34c54 req-e89da360-b74e-47d5-be48-16720080191f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:33.368166 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-d6835897-f6f8-49e1-8f43-41fc76b34c54 req-e89da360-b74e-47d5-be48-16720080191f service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:33.384425 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-d6835897-f6f8-49e1-8f43-41fc76b34c54 req-e89da360-b74e-47d5-be48-16720080191f service nova] Creating event network-vif-deleted:c6f101c2-0d66-4737-8b55-0b676cd19e98 for instance ac3cace2-f508-4c4e-bde5-7568c541c9cb on hv-cinder-84630 Jun 21 19:15:33.391229 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-d6835897-f6f8-49e1-8f43-41fc76b34c54 req-e89da360-b74e-47d5-be48-16720080191f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Jun 21 19:15:33.391844 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 518/1045] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:33.735126 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:33.735744 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:33.743230 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:33.743688 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:33.744500 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:33.744905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:33.776866 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:33.777347 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:33.777809 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lazy-loading 'fault' on Instance uuid ac3cace2-f508-4c4e-bde5-7568c541c9cb {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:15:33.824207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd39a103c444535b0bf643f45d91945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b918ee36fa4888a6d708cfac6c2995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:33.831353 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e782e301-5572-4877-8fa5-379f0506e93d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 200 len: 1305 microversion: 2.1 time: 0.100765 Jun 21 19:15:33.831920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 528/1046] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:33 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:34.848887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:34.849628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] [instance: ac3cace2-f508-4c4e-bde5-7568c541c9cb] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:34.856646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:34.857551 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:34.858343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:34.858786 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:34.871912 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] HTTP exception thrown: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Request method failure captured: Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb HTTP/1.1 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishjDTaeYqp0OOnORsPJ-RmXTJyr1favcduwZek5YfAPZhTr51UOIxf_FSeDy9Q6hVgw_xDIvJ6kCjHBhkqta2S2BBmxtDzKeo6STZRxo0Z92gw7ECnnpx_1xXD31pX9gR4xoT6vZ7stwDbu1nqJXFy1OOvgBhAk3kskLyPLQAEr8JyY Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 71b918ee36fa4888a6d708cfac6c2995 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-VolumesNegativeTest-1964435297 Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:15:34.874146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71b918ee36fa4888a6d708cfac6c2995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71b918ee36fa4888a6d708cfac6c2995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71b918ee36fa4888a6d708cfac6c2995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71b918ee36fa4888a6d708cfac6c2995"}]}] Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-VolumesNegativeTest-1964435297 Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 71b918ee36fa4888a6d708cfac6c2995 Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-VolumesNegativeTest-1964435297 Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-VolumesNegativeTest-1964435297-project Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 2bd39a103c444535b0bf643f45d91945 Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-VolumesNegativeTest-1964435297-project Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. Jun 21 19:15:34.876842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'ac3cace2-f508-4c4e-bde5-7568c541c9cb'} Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:15:34.878322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. Jun 21 19:15:34.881388 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:34.884379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] Returning 404 to user: Instance ac3cace2-f508-4c4e-bde5-7568c541c9cb could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:15:34.884379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b5dbbf98-5b91-4fbf-8418-139a4316aa3d tempest-VolumesNegativeTest-1964435297 tempest-VolumesNegativeTest-1964435297-project] 10.222.0.70 "GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb" status: 404 len: 111 microversion: 2.1 time: 0.030857 Jun 21 19:15:34.884379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 519/1047] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:34 2022] GET /compute/v2.1/servers/ac3cace2-f508-4c4e-bde5-7568c541c9cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:15:40.424890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:40.425538 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:40.432141 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.432594 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.433693 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.433858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.459636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-aa322cd2-a022-49b6-b310-2bb6d0423040 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/ips" status: 200 len: 150 microversion: 2.1 time: 0.038606 Jun 21 19:15:40.465723 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 529/1048] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:15:40 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:40.471470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2c1c6e-c6dc-43ca-879c-06e999798b82"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:40.472587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:40.479462 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.479916 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.480826 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.481390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.573023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: POST /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/os-volume_attachments HTTP/1.1 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 74 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:15:40.574841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {"volumeAttachment": {"volumeId": "ca2c1c6e-c6dc-43ca-879c-06e999798b82"}} Jun 21 19:15:40.576738 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': 'b3bb88a5-7007-4d70-ad69-a0b2c4307f53', 'body': {'volumeAttachment': {'volumeId': 'ca2c1c6e-c6dc-43ca-879c-06e999798b82'}}} Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:40.577797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:40.579399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 400 to user: Invalid volume: volume ca2c1c6e-c6dc-43ca-879c-06e999798b82 is already attached to instances: 1a45ca17-da52-48bf-9d33-860f2652bd91 {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:15:40.580992 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-dcefcd79-fb4b-40be-801c-b9b4179f1f62 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110275 Jun 21 19:15:40.586808 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:40.587308 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:40.590067 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 520/1049] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:15:40 2022] POST /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:15:40.594262 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.594727 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.595524 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.595958 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.643639 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:15:40.766877 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-40e16b00-4b72-411a-890d-d18e73142275 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 204 len: 0 microversion: 2.1 time: 0.183355 Jun 21 19:15:40.770916 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 530/1050] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:15:40 2022] DELETE /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:15:40.779760 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:40.780861 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:40.788617 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.789463 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.790504 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:40.791168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:40.979481 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:40.989233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-84738990-b7ab-4230-bf48-1fb0f2afb436 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1682 microversion: 2.1 time: 0.216183 Jun 21 19:15:40.989949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 521/1051] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:40 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:42.007737 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:42.009050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:42.020362 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:42.021214 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:42.022104 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:42.022606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:42.186363 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:42.195033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9f2cf86f-160c-4c9b-8456-91cd5d15dcdc tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1682 microversion: 2.1 time: 0.191391 Jun 21 19:15:42.195634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 531/1052] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:42 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:43.217732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:43.219709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:43.229740 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:43.230580 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:43.232258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:43.233106 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:43.391866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:43.402832 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2f6ed582-ea61-4b14-8ddd-466171ad6925 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 200 len: 1614 microversion: 2.1 time: 0.193367 Jun 21 19:15:43.403888 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 522/1053] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:43 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 1614 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:43.689672 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-ca810502-e7d0-4a7e-b9d6-40505195bbfe req-615f424a-877f-4ac5-87d0-12f15632579d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bb88a5-7007-4d70-ad69-a0b2c4307f53", "name": "network-vif-deleted", "tag": "c7e2fa1a-911f-460c-897f-d05c13a839cc"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:43.715033 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ca810502-e7d0-4a7e-b9d6-40505195bbfe req-615f424a-877f-4ac5-87d0-12f15632579d service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:43.719808 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ca810502-e7d0-4a7e-b9d6-40505195bbfe req-615f424a-877f-4ac5-87d0-12f15632579d service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:43.756675 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-ca810502-e7d0-4a7e-b9d6-40505195bbfe req-615f424a-877f-4ac5-87d0-12f15632579d service nova] Creating event network-vif-deleted:c7e2fa1a-911f-460c-897f-d05c13a839cc for instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 on hv-cinder-84630 Jun 21 19:15:43.767062 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-ca810502-e7d0-4a7e-b9d6-40505195bbfe req-615f424a-877f-4ac5-87d0-12f15632579d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084147 Jun 21 19:15:43.777722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 532/1054] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:44.421982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:44.422522 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:44.439200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:44.443523 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:44.447347 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:44.452468 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:44.493623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 HTTP/1.1 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:15:44.503378 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:15:44.504953 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b3bb88a5-7007-4d70-ad69-a0b2c4307f53'} Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:15:44.505812 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:15:44.507207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:15:44.510049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:15:44.510049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5126dd5c-a28a-4ff5-a4c2-a42afda26f63 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 404 len: 111 microversion: 2.1 time: 0.089709 Jun 21 19:15:44.510049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 523/1055] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:44 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:15:44.521059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f540a1f-b1f2-4f5c-ba53-82d721364bd8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '.version_select at 0x7f3595b3ef70>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:44.555270 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f540a1f-b1f2-4f5c-ba53-82d721364bd8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653216461" status: 202 len: 0 microversion: 2.1 time: 0.042050 Jun 21 19:15:44.557779 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 533/1056] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 19:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653216461 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:15:45.594180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:45.594722 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:45.605533 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:45.606330 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:45.607501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:45.607958 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:45.777158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lazy-loading 'services' on Instance uuid 1a45ca17-da52-48bf-9d33-860f2652bd91 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:15:45.877426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-34ce7789-0ba6-406d-8dd8-3036f22b5d1e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments/ca2c1c6e-c6dc-43ca-879c-06e999798b82" status: 202 len: 0 microversion: 2.1 time: 0.289146 Jun 21 19:15:45.880997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 524/1057] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:15:45 2022] DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments/ca2c1c6e-c6dc-43ca-879c-06e999798b82 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:15:45.887789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:45.889492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:45.898910 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:45.899479 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:45.900144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:45.900571 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:45.946285 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1617dc66-d1bd-4722-a245-83f8d915e37a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063543 Jun 21 19:15:45.947159 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 534/1058] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:15:45 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:46.958703 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:46.959777 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:46.967545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:46.967749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:46.969263 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:46.969707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:47.005408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-93b6748c-33df-4a02-b64b-31715505cc04 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050784 Jun 21 19:15:47.025400 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 525/1059] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:15:46 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:15:47.091211 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:47.091755 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:47.100043 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:47.100771 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:47.101587 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:47.102015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:47.129314 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:47.144423 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:15:47.263081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5bb8cef4-66c4-4277-9ad4-2e2f58bf4e94 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 204 len: 0 microversion: 2.1 time: 0.175521 Jun 21 19:15:47.265397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 535/1060] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:15:47 2022] DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:15:47.275119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:47.276081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:47.287256 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:47.288113 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:47.288997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:47.289495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:47.690027 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:47.696778 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:47.700206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-17bc2558-b94a-4dce-8f70-c648e3a52b93 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1681 microversion: 2.1 time: 0.430119 Jun 21 19:15:47.703157 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 526/1061] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:47 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1681 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:15:48.721127 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:48.721868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:48.724342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:48.738220 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:48.739010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:48.741521 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:48.742149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:48.980573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:48.990338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1190967d-7e8c-41b6-b0c3-a540dc118676 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1681 microversion: 2.1 time: 0.273756 Jun 21 19:15:48.996323 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 536/1062] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:48 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:50.021745 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:50.022376 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:50.030857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:15:50.055618 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:50.056754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:50.059817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:50.066959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:50.344110 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:50.356552 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ef5460a5-20c8-4533-8d59-1e4a62ba8279 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1681 microversion: 2.1 time: 0.348153 Jun 21 19:15:50.370595 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 527/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:50 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1681 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:50.963288 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-7144ae09-0108-4cfb-ad27-754b287cd8af req-002cd598-db1c-4d21-a3aa-f5bbcfa3563a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45ca17-da52-48bf-9d33-860f2652bd91", "name": "network-vif-deleted", "tag": "04a64e0b-7e64-4082-a247-ef55ea2f3052"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:50.975828 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7144ae09-0108-4cfb-ad27-754b287cd8af req-002cd598-db1c-4d21-a3aa-f5bbcfa3563a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:50.976878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-7144ae09-0108-4cfb-ad27-754b287cd8af req-002cd598-db1c-4d21-a3aa-f5bbcfa3563a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:51.010483 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-7144ae09-0108-4cfb-ad27-754b287cd8af req-002cd598-db1c-4d21-a3aa-f5bbcfa3563a service nova] Creating event network-vif-deleted:04a64e0b-7e64-4082-a247-ef55ea2f3052 for instance 1a45ca17-da52-48bf-9d33-860f2652bd91 on hv-cinder-84630 Jun 21 19:15:51.020573 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-7144ae09-0108-4cfb-ad27-754b287cd8af req-002cd598-db1c-4d21-a3aa-f5bbcfa3563a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062394 Jun 21 19:15:51.026554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 537/1064] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:15:51.387431 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:51.388096 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:51.402432 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:51.402894 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:51.403736 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:51.404183 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:51.461421 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:51.461885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:51.462350 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lazy-loading 'fault' on Instance uuid 1a45ca17-da52-48bf-9d33-860f2652bd91 {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:15:51.515119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:51.531127 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d84e7dea-4476-43f1-9bec-3dd72c8adaab tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 200 len: 1331 microversion: 2.1 time: 0.158771 Jun 21 19:15:51.532062 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 528/1065] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:51 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:52.550179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:52.550896 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:52.575266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:52.583086 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:52.588301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:52.592172 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:52.616388 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 HTTP/1.1 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:15:52.618263 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:15:52.619725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '1a45ca17-da52-48bf-9d33-860f2652bd91'} Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:15:52.620649 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:15:52.624992 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:15:52.627763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:15:52.627763 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4bb39de0-7470-4fcd-a360-875e384a7f2e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 404 len: 111 microversion: 2.1 time: 0.075979 Jun 21 19:15:52.636380 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-5e6a445c-772f-4b37-9eeb-93bc72eb1351 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '.version_select at 0x7f35958f1c10>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:52.641304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 538/1066] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:52 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:15:52.684876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-5e6a445c-772f-4b37-9eeb-93bc72eb1351 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541332911" status: 202 len: 0 microversion: 2.1 time: 0.057376 Jun 21 19:15:52.689455 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 529/1067] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 19:15:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541332911 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:15:53.553453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e810d812-ecc9-46c8-a446-beee16ebef4e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: .version_select at 0x7f35959940d0>, body: {"keypair": {"name": "tempest-keypair-2063684857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP/OVq6S2ukhWxvlJVeQttcpy93RtwvPWa8o/c4MEyvxL2Niyli/YYXOmm/tpFEDLki/JlDJCZo+VsVjlrsVSLjryHU1XWJRLdWgwXRWYDca346Qc7vulwALmrL1s4TWA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:53.592706 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e810d812-ecc9-46c8-a446-beee16ebef4e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:15:53.597684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-e810d812-ecc9-46c8-a446-beee16ebef4e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:15:53.627666 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e810d812-ecc9-46c8-a446-beee16ebef4e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078267 Jun 21 19:15:53.629284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 539/1068] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:15:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:15:55.750407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-659641101", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e9591ce-30ff-4920-8896-3d382a8c79e7"}], "security_groups": [{"name": "tempest-securitygroup--1890469107"}], "key_name": "tempest-keypair-2063684857", "user_data": "}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:55.936936 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] validate_networks() for [('8e9591ce-30ff-4920-8896-3d382a8c79e7', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:15:56.625895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:15:56.626318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:15:56.626791 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:15:56.627198 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:15:56.627761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:15:56.638564 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:56.639381 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:56.640461 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:56.641193 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:56.672527 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:15:56.677407 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:15:56.694351 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:15:56.696728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:15:56.766495 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-90170d40-2e7b-43aa-831b-f72ea121bf16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.022852 Jun 21 19:15:56.767868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 530/1069] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:15:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:15:56.778075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5629f47c-1e80-4e7c-b693-814e3496e55a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:56.780199 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5629f47c-1e80-4e7c-b693-814e3496e55a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:56.858332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5629f47c-1e80-4e7c-b693-814e3496e55a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:56.867060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5629f47c-1e80-4e7c-b693-814e3496e55a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1241 microversion: 2.1 time: 0.092435 Jun 21 19:15:56.867465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 540/1070] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:56 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:57.887911 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:57.890186 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:57.916742 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:57.920258 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:57.922053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:57.923379 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:58.056382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:58.069827 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-d99053fc-debc-4e35-b1d9-bc501b5415d8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1311 microversion: 2.1 time: 0.189178 Jun 21 19:15:58.070435 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 531/1071] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:57 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:59.300702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:15:59.302009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:15:59.309842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:59.310358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:59.311875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:59.312330 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:59.574078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:15:59.585700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef92275b-09b9-4736-987b-436c18b1e8d5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.496956 Jun 21 19:15:59.602623 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 541/1072] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:15:59 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:15:59.754249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-2c010a1f-9a7a-40b6-ba05-7092c396d3b7 req-d2fe78a8-fc4d-4066-8adf-b608d2f666f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09c9c29-82b9-4d35-8022-04083404488f", "tag": "c2cb5ee8-441a-4059-9bc7-f1e696a457fe"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:15:59.796971 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2c010a1f-9a7a-40b6-ba05-7092c396d3b7 req-d2fe78a8-fc4d-4066-8adf-b608d2f666f4 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:15:59.800889 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-2c010a1f-9a7a-40b6-ba05-7092c396d3b7 req-d2fe78a8-fc4d-4066-8adf-b608d2f666f4 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:15:59.829023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-2c010a1f-9a7a-40b6-ba05-7092c396d3b7 req-d2fe78a8-fc4d-4066-8adf-b608d2f666f4 service nova] Creating event network-changed:c2cb5ee8-441a-4059-9bc7-f1e696a457fe for instance c09c9c29-82b9-4d35-8022-04083404488f on hv-cinder-84630 Jun 21 19:15:59.842999 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-2c010a1f-9a7a-40b6-ba05-7092c396d3b7 req-d2fe78a8-fc4d-4066-8adf-b608d2f666f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101809 Jun 21 19:15:59.844143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 532/1073] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:00.609341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:00.610546 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:00.619243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:00.620072 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:00.620905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:00.621404 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:00.787018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:00.795718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9094d606-705c-49b4-bc12-db9b6430000d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.191618 Jun 21 19:16:00.805712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 542/1074] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:00 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:01.813442 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:01.814759 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:01.821307 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:01.821751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:01.822696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:01.823298 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:01.972852 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:01.981417 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7e7157a8-14cf-4372-bc1b-d3308309236c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.172796 Jun 21 19:16:01.981982 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 533/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:01 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:02.034069 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1896b8e7-fbc7-45f9-bd1a-56d62b48bde3 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'create', calling method: .version_select at 0x7f35959d71f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-448146508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+HEK69shEffoWIy4roKuMQbjMVAyl/Bn1YqllzOOn74Qnltl+8mkEwZQ4pz4/FtLVKEX1YgyZlNFPEhMy5T9RYZQytbRdAeE/65YNz/q+B/gFXqcAjhdVBeksftb3UjA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:02.048243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-1896b8e7-fbc7-45f9-bd1a-56d62b48bde3 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Getting quotas for project 193a4ca8d19f449588f3b46389c14f06. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:16:02.051981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-1896b8e7-fbc7-45f9-bd1a-56d62b48bde3 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Getting quotas for user e334063c001a4435940d7cf850ec350f and project 193a4ca8d19f449588f3b46389c14f06. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:16:02.074710 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1896b8e7-fbc7-45f9-bd1a-56d62b48bde3 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044445 Jun 21 19:16:02.075838 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 543/1076] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:16:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:02.124548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-754868246", "imageRef": "987d6885-9cbe-46c2-941f-7cf895ae3ddd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-448146508", "networks": [{"uuid": "bdae47f2-ae0d-4ad8-bc3b-015ded0afbb6"}]}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:02.173938 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.network.neutron [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] validate_networks() for [('bdae47f2-ae0d-4ad8-bc3b-015ded0afbb6', None, None, None, None, None)] {{(pid=117618) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:16:02.677201 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Flavor limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:16:02.677639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Image limits 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:16:02.678118 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Flavor pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:16:02.678579 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Image pref 0:0:0 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:16:02.678997 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.virt.hardware [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:16:02.689959 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:02.690410 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:02.691216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:02.691653 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:02.709614 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Getting quotas for project 193a4ca8d19f449588f3b46389c14f06. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:16:02.713690 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.quota [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Getting quotas for user e334063c001a4435940d7cf850ec350f and project 193a4ca8d19f449588f3b46389c14f06. Resources: {'instances', 'cores', 'ram'} {{(pid=117618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:16:02.724754 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Going to run 1 instances... {{(pid=117618) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:16:02.727049 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987d6885-9cbe-46c2-941f-7cf895ae3ddd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:16:02.773641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e66bb4ff-ecbe-4d8f-9dfd-3b6ce415f104 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653423 Jun 21 19:16:02.779413 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 534/1077] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:16:02.784973 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d83d22cd-7501-47d2-83ad-a7b28d3d35f9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:02.785630 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d83d22cd-7501-47d2-83ad-a7b28d3d35f9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:02.850075 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d83d22cd-7501-47d2-83ad-a7b28d3d35f9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:02.859890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d83d22cd-7501-47d2-83ad-a7b28d3d35f9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1257 microversion: 2.1 time: 0.079116 Jun 21 19:16:02.860620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 544/1078] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:02 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1257 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:02.998164 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:02.998780 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:03.008287 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:03.008794 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:03.009531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:03.009963 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:03.150862 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:03.159695 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-8b33627c-5701-449e-9dd0-bf84fb4faddb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.166251 Jun 21 19:16:03.160275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 535/1079] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:02 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:03.877235 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:03.877988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:03.884443 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:03.884872 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:03.885694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:03.886105 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:03.960018 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:03.969293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-68859853-bc9d-44c7-9469-9a7a930294ad tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1315 microversion: 2.1 time: 0.095825 Jun 21 19:16:03.970204 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 545/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:03 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:16:04.182200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:04.185559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:04.196929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:04.198178 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:04.199356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:04.200189 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:04.701817 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:04.712371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2005739a-5e95-45b7-b08f-7001b232d035 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.537843 Jun 21 19:16:04.733751 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 536/1081] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:04 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:04.986884 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:04.988518 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:05.000914 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:05.001835 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:05.002857 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:05.003517 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:05.215418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:05.224163 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-db353ffa-656d-4ca2-a4c5-392e2e68fda5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.241259 Jun 21 19:16:05.225303 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 546/1082] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:04 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:05.752699 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:05.753348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:05.760060 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:05.760509 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:05.761337 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:05.761775 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:05.900866 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:05.908986 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c71d8c47-246b-403c-895b-5031b0a07916 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.160120 Jun 21 19:16:05.909611 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 537/1083] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:05 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:06.243580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:06.245010 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:06.253418 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:06.253878 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:06.254666 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:06.255108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:06.413793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:06.421719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-6b7f686f-30cb-4bd3-a286-4dea38f02ef4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.183971 Jun 21 19:16:06.427996 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 547/1084] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:06 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:06.894340 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-387ea953-182d-49ff-b3a6-d0ec8c2d91eb req-dc228dd6-6b9c-43de-91e8-9cf3ebe6df0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09c9c29-82b9-4d35-8022-04083404488f", "name": "network-vif-plugged", "status": "completed", "tag": "c2cb5ee8-441a-4059-9bc7-f1e696a457fe"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:06.908952 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-387ea953-182d-49ff-b3a6-d0ec8c2d91eb req-dc228dd6-6b9c-43de-91e8-9cf3ebe6df0a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:06.909958 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-387ea953-182d-49ff-b3a6-d0ec8c2d91eb req-dc228dd6-6b9c-43de-91e8-9cf3ebe6df0a service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:06.925479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-387ea953-182d-49ff-b3a6-d0ec8c2d91eb req-dc228dd6-6b9c-43de-91e8-9cf3ebe6df0a service nova] Creating event network-vif-plugged:c2cb5ee8-441a-4059-9bc7-f1e696a457fe for instance c09c9c29-82b9-4d35-8022-04083404488f on hv-cinder-84630 Jun 21 19:16:06.931257 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-387ea953-182d-49ff-b3a6-d0ec8c2d91eb req-dc228dd6-6b9c-43de-91e8-9cf3ebe6df0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060296 Jun 21 19:16:06.932161 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 538/1085] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:06.938998 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:06.939227 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:06.949119 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:06.949690 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:06.950648 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:06.951137 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:07.103563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:07.111541 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-31a7a6a5-c097-4ca3-bdea-78e3f84bb32d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.178383 Jun 21 19:16:07.112094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 548/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:06 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:07.439172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:07.439885 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:07.446710 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:07.447171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:07.447957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:07.448397 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:07.584081 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:07.593907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2753c148-a47d-422f-9c28-d70ec8d8fe01 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.158847 Jun 21 19:16:07.603180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 539/1087] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:07 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:08.132059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:08.132677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:08.139228 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:08.139677 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:08.140446 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:08.140887 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:08.287558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:08.295981 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-459dc08a-1f70-43c2-8cfe-1cc5566b546b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.167806 Jun 21 19:16:08.296665 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 549/1088] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:08 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:08.610987 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:08.611704 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:08.618670 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:08.619126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:08.619887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:08.620319 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:08.757186 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:08.765390 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ae4e2629-bc9a-4ac3-a3e2-35804b9c0ecd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.158162 Jun 21 19:16:08.765962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 540/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:08 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:09.313504 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:09.314102 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:09.320861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:09.321339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:09.322101 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:09.322530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:09.473527 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:09.481852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-35018ab5-63a4-4756-925e-f7b8d01c7e16 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.172201 Jun 21 19:16:09.492180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 550/1090] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:09 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:09.786301 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:09.786945 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:09.793556 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:09.794056 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:09.794831 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:09.795279 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:09.940282 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:09.950958 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f0bdb29a-fdd0-4cf1-a8a4-e36500da7e00 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.171760 Jun 21 19:16:09.951532 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 541/1091] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:09 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:10.499232 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:10.499821 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:10.508217 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:10.508786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:10.509789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:10.510339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:10.656038 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:10.664169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-7e4417f4-e2f9-43f8-9822-678ff49a3440 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.168663 Jun 21 19:16:10.665121 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 551/1092] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:10 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:10.970040 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:10.971465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:10.992927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:10.993543 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:10.994616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:10.995452 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:11.148706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:11.156790 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-026128e4-4664-40b9-b960-82e18f813e32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.192813 Jun 21 19:16:11.157598 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 542/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:10 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:11.681978 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:11.682592 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:11.690372 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:11.690819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:11.691585 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:11.692022 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:11.823289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:11.830875 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-954e4175-91d9-462e-8f1a-7c887c142f01 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.152800 Jun 21 19:16:11.831442 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 552/1094] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:11 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:12.174558 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:12.175115 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:12.181697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:12.182153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:12.182924 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:12.183362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:12.316052 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:12.324061 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-efb158d1-46ab-434f-bd61-c93d4dc57b87 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.153962 Jun 21 19:16:12.324928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 543/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:12 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:12.847778 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:12.848416 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:12.854986 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:12.855429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:12.856183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:12.857275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:12.859901 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=12 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:12.986890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:12.994327 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-383a357c-2e69-41db-87f1-b239e03e88be tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.150392 Jun 21 19:16:12.994888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 553/1096] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:12 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:13.341681 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:13.342309 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:13.344239 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=4 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:13.345029 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=12 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:13.351663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:13.352109 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:13.353077 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:13.353341 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:13.484141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:13.491590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-da1dd32f-9a34-4516-aade-dc184b9d4043 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.153844 Jun 21 19:16:13.492145 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 544/1097] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:13 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:14.012393 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:14.013067 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:14.019624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:14.020073 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:14.020861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:14.021338 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:14.159670 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:14.167144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-84f0ec6d-d28b-4626-8b64-50f9d9f3ae87 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.158879 Jun 21 19:16:14.167708 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 554/1098] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:14 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:14.508599 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:14.509480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:14.516664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:14.517143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:14.517916 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:14.518354 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:14.653750 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:14.661487 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-14df5e8f-4b74-4ac3-b500-24c7eff51241 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.156639 Jun 21 19:16:14.662086 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 545/1099] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:14 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:15.184167 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:15.185526 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:15.192076 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:15.192529 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:15.193342 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:15.193786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:15.417046 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:15.421276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:15.426143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5548f9fb-e458-4ea7-89c5-6711c73238bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.245875 Jun 21 19:16:15.426728 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 555/1100] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:15 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:15.678496 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:15.679288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:15.685783 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:15.686184 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:15.686966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:15.687406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:15.711261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-dd90bd8a-9589-4785-8be5-8a2c1ab025c4 req-d7b7248e-5214-4911-8c57-5f0231bf659d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:15.727002 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-dd90bd8a-9589-4785-8be5-8a2c1ab025c4 req-d7b7248e-5214-4911-8c57-5f0231bf659d service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:15.727584 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-dd90bd8a-9589-4785-8be5-8a2c1ab025c4 req-d7b7248e-5214-4911-8c57-5f0231bf659d service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:15.760497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-dd90bd8a-9589-4785-8be5-8a2c1ab025c4 req-d7b7248e-5214-4911-8c57-5f0231bf659d service nova] Creating event network-changed:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:16:15.766194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-dd90bd8a-9589-4785-8be5-8a2c1ab025c4 req-d7b7248e-5214-4911-8c57-5f0231bf659d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058658 Jun 21 19:16:15.769293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 556/1101] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:15.889970 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:15.892725 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=100 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:15.901658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-168e0fc4-0da3-462f-b6d9-394b94da4eda tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.227069 Jun 21 19:16:15.902415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 546/1102] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:15 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:16.448208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:16.449038 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:16.455802 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:16.456264 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:16.457034 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:16.457497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:16.675476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:16.683041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3829a7e0-afa3-4f28-a4df-4346cde8686f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1367 microversion: 2.1 time: 0.239777 Jun 21 19:16:16.683620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 557/1103] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:16 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:16.920606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:16.921185 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:16.928001 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:16.928536 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:16.929294 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:16.929711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:17.065243 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:17.074348 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bc527e30-4550-4412-96e0-812aef42ec42 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.158489 Jun 21 19:16:17.074935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 547/1104] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:16 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:17.701785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:17.702399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:17.708890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:17.709374 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:17.710144 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:17.710606 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:17.841883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:17.849426 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e9317c43-8c9c-449a-bc04-6c66a7fdeabd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1557 microversion: 2.1 time: 0.152052 Jun 21 19:16:17.850029 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 558/1105] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:17 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:17.865465 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:17.865966 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:17.872470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:17.872916 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:17.873728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:17.874162 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:17.951154 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-35c62f53-aded-4fff-a7b0-2096117d4023 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089566 Jun 21 19:16:17.951898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 548/1106] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:16:17 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:18.091424 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:18.092036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:18.098238 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:18.098694 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:18.099479 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:18.099920 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:18.333116 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:18.340701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0d818265-a8e9-4081-a6e6-bb2393ebbe6c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.253379 Jun 21 19:16:18.341313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 559/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:18 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:19.008105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-20a47b72-eb1a-49b3-8bb4-dd9f02638972 req-a652bf9a-118f-4c88-b1ee-125b304a62a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09c9c29-82b9-4d35-8022-04083404488f", "tag": "c2cb5ee8-441a-4059-9bc7-f1e696a457fe"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:19.017794 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-20a47b72-eb1a-49b3-8bb4-dd9f02638972 req-a652bf9a-118f-4c88-b1ee-125b304a62a8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:19.018577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-20a47b72-eb1a-49b3-8bb4-dd9f02638972 req-a652bf9a-118f-4c88-b1ee-125b304a62a8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:19.031728 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-20a47b72-eb1a-49b3-8bb4-dd9f02638972 req-a652bf9a-118f-4c88-b1ee-125b304a62a8 service nova] Creating event network-changed:c2cb5ee8-441a-4059-9bc7-f1e696a457fe for instance c09c9c29-82b9-4d35-8022-04083404488f on hv-cinder-84630 Jun 21 19:16:19.037265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-20a47b72-eb1a-49b3-8bb4-dd9f02638972 req-a652bf9a-118f-4c88-b1ee-125b304a62a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Jun 21 19:16:19.038047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 549/1108] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:19.358201 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:19.359907 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:19.364358 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:19.368968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:19.369942 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:19.370835 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:19.371511 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:19.589502 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:16:19.590050 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b (ip 10.222.0.70) !!! Jun 21 19:16:19.906469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:19.914476 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b9cfba18-103f-4ff4-a480-52f83113abb9 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.560252 Jun 21 19:16:19.915180 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 560/1109] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:19 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:20.933238 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:20.934706 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:20.936768 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:20.942654 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:20.943111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:20.943895 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:20.944770 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:21.088491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:21.096383 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-61ca02b7-a688-462d-9af0-c2a229d62ef6 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.167871 Jun 21 19:16:21.096955 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 550/1110] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:20 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:22.113309 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:22.113983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:22.120453 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:22.120905 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:22.121700 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:22.122145 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:22.255718 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:22.263739 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a9e1c14d-eaa0-4ddd-a492-7859821e560f tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.154484 Jun 21 19:16:22.264300 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 561/1111] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:22 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:22.920985 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-667f519a-8ef2-4854-be7a-9414c77c1c73 req-da846083-ba4d-4b8e-a193-9c7750f010da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "name": "network-vif-plugged", "status": "completed", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:22.929835 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-667f519a-8ef2-4854-be7a-9414c77c1c73 req-da846083-ba4d-4b8e-a193-9c7750f010da service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:22.930235 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-667f519a-8ef2-4854-be7a-9414c77c1c73 req-da846083-ba4d-4b8e-a193-9c7750f010da service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:22.942734 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-667f519a-8ef2-4854-be7a-9414c77c1c73 req-da846083-ba4d-4b8e-a193-9c7750f010da service nova] Creating event network-vif-plugged:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:16:22.948104 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-667f519a-8ef2-4854-be7a-9414c77c1c73 req-da846083-ba4d-4b8e-a193-9c7750f010da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031229 Jun 21 19:16:22.948660 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 551/1112] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:23.280473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:23.281174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:23.288015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:23.288459 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:23.289286 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:23.289722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:23.443015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:23.452904 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a681bf0d-e54c-4f3a-8181-36c87b64c7e5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.176641 Jun 21 19:16:23.453638 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 562/1113] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:23 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:24.473627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:24.474326 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:24.480569 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:24.481560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:24.482334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:24.482771 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:24.620586 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:24.628591 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1cb0db21-314a-4f34-9f6b-489ab1ef0bcd tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1357 microversion: 2.1 time: 0.159764 Jun 21 19:16:24.629195 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 552/1114] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:24 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:16:25.646456 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:25.647179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:25.654065 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:25.654516 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:25.655291 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:25.655729 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:25.792980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:25.801410 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-9e3387dd-7d09-4ac9-bda7-5e23bfcdd691 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1547 microversion: 2.1 time: 0.158911 Jun 21 19:16:25.802094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 563/1115] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:25 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:16:25.818446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:25.819296 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:25.827010 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:25.828028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:25.828841 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:25.829370 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:25.979207 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:25.989535 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b190ae64-4147-4091-a122-02bdeff3430d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1547 microversion: 2.1 time: 0.174690 Jun 21 19:16:25.990008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 553/1116] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:25 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:16:26.006422 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:26.010111 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:26.010893 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Searching by: {'deleted': False, 'project_id': '193a4ca8d19f449588f3b46389c14f06'} {{(pid=117619) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 19:16:26.018441 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:26.018908 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:26.019719 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:26.020161 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:26.118165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.multi_cell_list [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117619) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 19:16:26.217041 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d8c6f11a-6bb8-481d-b980-44e26eede6f7 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214518 Jun 21 19:16:26.217736 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 564/1117] 10.222.0.70 () {58 vars in 1124 bytes} [Tue Jun 21 19:16:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:16:26.228119 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:26.228739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:26.235453 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:26.235901 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:26.236684 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:26.237148 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:26.378089 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:26.386079 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f6ade067-6841-487b-950b-6235b1f8fcec tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1547 microversion: 2.1 time: 0.161817 Jun 21 19:16:26.386663 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 554/1118] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:26 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:28.002713 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0438a50d-860a-4b0d-b3d7-a5c01c914e6d"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:28.003749 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:28.010701 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:28.011149 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:28.011918 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:28.012898 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:28.275530 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a642daea-96fb-4f9b-b341-3b07e9671337 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276696 Jun 21 19:16:28.276210 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 565/1119] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:16:27 2022] POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:35.922488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:35.923641 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:35.936713 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:35.937548 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:35.938984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:35.939757 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:36.125484 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:36.134987 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a9f833c8-5456-4741-9bfe-63851a63c4a5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1593 microversion: 2.1 time: 0.221209 Jun 21 19:16:36.140824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 555/1120] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:35 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:16:38.194328 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:38.196283 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=11 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:16:38.205208 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-d8f14648-0821-46f8-a243-e8f1ebbc5667 req-84ccfd72-77d5-462b-8f91-cefa21dde6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:38.225261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d8f14648-0821-46f8-a243-e8f1ebbc5667 req-84ccfd72-77d5-462b-8f91-cefa21dde6e8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:38.226213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-d8f14648-0821-46f8-a243-e8f1ebbc5667 req-84ccfd72-77d5-462b-8f91-cefa21dde6e8 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:38.257004 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-d8f14648-0821-46f8-a243-e8f1ebbc5667 req-84ccfd72-77d5-462b-8f91-cefa21dde6e8 service nova] Creating event network-changed:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:16:38.267754 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-d8f14648-0821-46f8-a243-e8f1ebbc5667 req-84ccfd72-77d5-462b-8f91-cefa21dde6e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075877 Jun 21 19:16:38.269474 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 566/1121] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:39.659126 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2064628461"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:39.660149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:39.672172 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:39.673024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:39.674719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:39.675658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:39.861969 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.network.security_group_api [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Adding security group 77c4b153-6cf3-41da-b027-9216498f9b87 to port feef2fe6-388a-46b8-b3dc-0d004781e3b3 Jun 21 19:16:40.327069 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9e9226c4-c486-4ecc-97e2-622af85a19fb tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action" status: 202 len: 0 microversion: 2.1 time: 0.674360 Jun 21 19:16:40.334285 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 556/1122] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:16:39 2022] POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:16:40.355454 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-3ebfeb63-6f58-4c48-8e3d-52e0146210ec req-21f5ed81-7afd-4390-802d-76ff4a4ca85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:16:40.366428 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:16:40.368711 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:16:40.375313 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3ebfeb63-6f58-4c48-8e3d-52e0146210ec req-21f5ed81-7afd-4390-802d-76ff4a4ca85b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:40.376515 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-3ebfeb63-6f58-4c48-8e3d-52e0146210ec req-21f5ed81-7afd-4390-802d-76ff4a4ca85b service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:40.384802 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:40.386210 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:40.389190 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:16:40.390023 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:16:40.398604 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-3ebfeb63-6f58-4c48-8e3d-52e0146210ec req-21f5ed81-7afd-4390-802d-76ff4a4ca85b service nova] Creating event network-changed:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:16:40.407741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-3ebfeb63-6f58-4c48-8e3d-52e0146210ec req-21f5ed81-7afd-4390-802d-76ff4a4ca85b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071760 Jun 21 19:16:40.409469 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 567/1123] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:16:40.853545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:16:40.869494 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6966e373-efba-4c03-a1f2-2a3d2c745551 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1759 microversion: 2.1 time: 0.532859 Jun 21 19:16:40.870542 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 557/1124] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:16:40 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1759 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:45.874168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:17:45.875097 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:17:45.879612 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:45.880194 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:45.888478 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:45.888921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:45.889725 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:45.890155 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:45.916215 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-12aa5b6b-f02d-4c47-976e-151318fec9a8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/ips" status: 200 len: 150 microversion: 2.1 time: 0.044245 Jun 21 19:17:45.917379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 568/1125] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:17:45 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:17:47.314142 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77687449-be5d-43a5-8eb1-0ff875dbe248"}} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:17:47.315772 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:47.319525 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=15 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:17:47.321044 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=55 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:17:47.332042 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:47.332642 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:47.333672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:47.334372 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:47.771356 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ab70da7f-ea2c-42de-989b-4c4c063ef4e4 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465694 Jun 21 19:17:47.772324 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 558/1126] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:17:47 2022] POST /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:17:52.167087 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:17:52.167986 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:52.174752 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:52.175195 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:52.175966 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:52.176431 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:52.258994 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-78067853-d524-4a34-bfe6-1f7414f3d064 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action" status: 202 len: 0 microversion: 2.1 time: 0.096193 Jun 21 19:17:52.259647 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 569/1127] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:17:52 2022] POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:17:52.274211 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:52.277167 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:52.288639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:52.289419 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:52.290819 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:52.292223 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:52.583265 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:52.592919 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-40061039-b81d-48e2-b11e-4978475e7917 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1751 microversion: 2.1 time: 0.327883 Jun 21 19:17:52.593563 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 559/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:52 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1751 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:52.770171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:17:52.770498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:17:53.618001 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:53.618634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:53.625783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:53.626236 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:53.627025 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:53.627468 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:53.852722 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:53.862464 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-328ba3ba-2d5c-4ba1-9ca5-57ba6dffd85c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.248897 Jun 21 19:17:53.864569 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 570/1129] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:53 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:54.891702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:54.892305 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:54.904621 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:54.905449 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:54.906857 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:54.907628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.103158 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:55.112672 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-61f6c7ba-e390-4858-8e0c-c30d7d7a9e14 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.227295 Jun 21 19:17:55.113362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 560/1130] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:54 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:55.390015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77687449-be5d-43a5-8eb1-0ff875dbe248"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:17:55.391112 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:55.398081 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.398624 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.399419 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.399860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.488776 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: POST /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments HTTP/1.1 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 74 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:17:55.490560 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {"volumeAttachment": {"volumeId": "77687449-be5d-43a5-8eb1-0ff875dbe248"}} Jun 21 19:17:55.492580 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'server_id': 'c09c9c29-82b9-4d35-8022-04083404488f', 'body': {'volumeAttachment': {'volumeId': '77687449-be5d-43a5-8eb1-0ff875dbe248'}}} Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:17:55.495574 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:17:55.498861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 400 to user: Invalid volume: volume 77687449-be5d-43a5-8eb1-0ff875dbe248 is already attached to instances: c09c9c29-82b9-4d35-8022-04083404488f {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-dd6b1a89-1f22-465a-a332-a8f10a440d58 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106135 Jun 21 19:17:55.501698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 571/1131] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:17:55 2022] POST /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 19:17:55.562063 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:55.562578 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:55.568899 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.569399 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.570200 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.570639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.659947 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lazy-loading 'services' on Instance uuid c09c9c29-82b9-4d35-8022-04083404488f {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:17:55.758402 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-75eca3e8-d2bf-45d7-96a8-f0d699faf923 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments/77687449-be5d-43a5-8eb1-0ff875dbe248" status: 202 len: 0 microversion: 2.1 time: 0.200855 Jun 21 19:17:55.759107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 561/1132] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:17:55 2022] DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments/77687449-be5d-43a5-8eb1-0ff875dbe248 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:17:55.768928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:55.769914 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:55.777888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.778265 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.779213 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:55.779699 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:55.822864 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-e523efef-9ff9-43f1-8d3d-fe60e2b9953d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058845 Jun 21 19:17:55.823444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 572/1133] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:17:55 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:17:56.132951 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:56.133805 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:56.141362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.141914 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.142788 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.143275 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.317334 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:56.327451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-0b114b3d-3313-4c8e-84f8-851446c3c747 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.199282 Jun 21 19:17:56.328032 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 562/1134] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:56 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:56.835284 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:56.836153 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:56.843248 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.843698 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.844492 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.844934 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.880008 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4020c6bd-8cd7-4471-a3d4-ebe297e8a3dd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048865 Jun 21 19:17:56.880594 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 573/1135] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:17:56 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 19:17:56.944650 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:56.945173 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:56.952377 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.952823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.953678 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:56.954109 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:56.982949 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Going to try to terminate instance {{(pid=117618) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:17:57.071638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1c8dfe68-6737-4f30-9f3b-3b73b4f3cff2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 204 len: 0 microversion: 2.1 time: 0.130365 Jun 21 19:17:57.072232 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 563/1136] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:17:56 2022] DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 19:17:57.080916 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:57.081578 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:57.088438 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:57.088789 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:57.089618 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:57.090078 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:57.247184 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:57.257987 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-21a5afed-6330-4029-bd9c-d7bf4bcbe7e1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1682 microversion: 2.1 time: 0.181056 Jun 21 19:17:57.258819 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 574/1137] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:57 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:17:57.345906 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:57.346559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:57.354418 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:57.354908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:57.355694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:57.356128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:57.523890 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:57.533312 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-f8c1d37f-7fb8-4731-9e49-923abbb43eab tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.191738 Jun 21 19:17:57.533927 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 564/1138] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:57 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:58.277467 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:58.278207 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:58.284943 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:58.285455 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:58.286243 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:58.286684 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:58.450559 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:58.458669 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-efa8995a-32d6-4dcd-93ca-68b5f653a6cd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1682 microversion: 2.1 time: 0.185755 Jun 21 19:17:58.459259 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 575/1139] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:58 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:58.551707 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:58.552343 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:58.559627 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:58.560093 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:58.560892 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:58.561366 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:58.736957 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:58.752498 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ff14d296-885e-40da-ac44-0ad2ace570d1 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.204363 Jun 21 19:17:58.753419 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 565/1140] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:58 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:17:59.477866 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:59.479279 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:59.486032 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:59.486473 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:59.487261 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:59.487768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:59.772174 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:17:59.772834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:17:59.779848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:59.780295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:59.781073 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:17:59.781538 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:17:59.819918 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:17:59.829304 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a93e32d3-6e7b-4f56-99c8-4ce5fe817ff0 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1682 microversion: 2.1 time: 0.355402 Jun 21 19:17:59.830094 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 576/1141] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:59 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1682 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:00.084587 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:00.100045 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9b2b9c35-8070-472c-9e31-4c6ae5da7cd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.332001 Jun 21 19:18:00.101132 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 566/1142] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:17:59 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:00.372716 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-ea3dd366-501d-4c2b-a6dd-2f33f639288c req-1077c192-4e48-4769-bdfb-e1a708a397e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09c9c29-82b9-4d35-8022-04083404488f", "name": "network-vif-deleted", "tag": "c2cb5ee8-441a-4059-9bc7-f1e696a457fe"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:00.383682 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ea3dd366-501d-4c2b-a6dd-2f33f639288c req-1077c192-4e48-4769-bdfb-e1a708a397e5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:00.384120 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-ea3dd366-501d-4c2b-a6dd-2f33f639288c req-1077c192-4e48-4769-bdfb-e1a708a397e5 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:00.398563 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-ea3dd366-501d-4c2b-a6dd-2f33f639288c req-1077c192-4e48-4769-bdfb-e1a708a397e5 service nova] Creating event network-vif-deleted:c2cb5ee8-441a-4059-9bc7-f1e696a457fe for instance c09c9c29-82b9-4d35-8022-04083404488f on hv-cinder-84630 Jun 21 19:18:00.405179 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-ea3dd366-501d-4c2b-a6dd-2f33f639288c req-1077c192-4e48-4769-bdfb-e1a708a397e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Jun 21 19:18:00.406519 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 577/1143] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:18:00.848242 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:00.849035 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:00.856269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:00.857080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:00.857898 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:00.858520 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:00.898374 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:00.898823 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:00.899490 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lazy-loading 'fault' on Instance uuid c09c9c29-82b9-4d35-8022-04083404488f {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:18:00.947015 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:00.955531 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-4f0ca576-57f1-40ea-883a-fa18b0d1ffcd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 200 len: 1331 microversion: 2.1 time: 0.111220 Jun 21 19:18:00.956107 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 567/1144] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:00 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:01.120344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:01.121211 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:01.128326 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:01.128786 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:01.129634 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:01.130091 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:01.310140 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:01.319561 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-173506fb-9493-4b33-8514-261f803803f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.204615 Jun 21 19:18:01.320609 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 578/1145] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:01 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:01.983645 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:01.984292 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:01.991562 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:01.992080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:01.993020 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:01.993553 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:02.009907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f HTTP/1.1 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:18:02.013530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:18:02.015295 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'c09c9c29-82b9-4d35-8022-04083404488f'} Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:18:02.016250 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:18:02.017935 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:18:02.019415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:18:02.019415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-6e9256cc-c11f-487b-9823-6fc0ba55dde2 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 404 len: 111 microversion: 2.1 time: 0.039036 Jun 21 19:18:02.019415 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 568/1146] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:01 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 19:18:02.027389 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8cf68341-e57c-499b-90ee-337a6e68632e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '.version_select at 0x7f3595b6c820>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:02.047146 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8cf68341-e57c-499b-90ee-337a6e68632e tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063684857" status: 202 len: 0 microversion: 2.1 time: 0.024311 Jun 21 19:18:02.047747 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 579/1147] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 19:18:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063684857 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 19:18:02.347149 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:02.348216 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:02.359491 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:02.360749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:02.361673 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:02.362322 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:02.647068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:02.656024 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bf813cd8-43df-49ea-a6aa-e8a9dfb5c4dc tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.315070 Jun 21 19:18:02.656616 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 569/1148] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:02 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:02.961663 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-8148e92d-a714-4c31-a5c3-1cecb747f4fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: .version_select at 0x7f3595994820>, body: {"keypair": {"name": "tempest-keypair-1809019199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVhzQg8sJjArFXuzZSmFu0vO5usVdZjIQHfuGqOrEMtosJDoJ7yNXDRKpb4iP0tAC3U2yiq8b4U/yXvzrQ+mwDajTbgxEKCRV8sQTLeOg3ir0Nt3gbRyB6A+isAhVsWKA=="}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:02.979695 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8148e92d-a714-4c31-a5c3-1cecb747f4fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:18:02.984693 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-8148e92d-a714-4c31-a5c3-1cecb747f4fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'key_pairs'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:18:03.013165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-8148e92d-a714-4c31-a5c3-1cecb747f4fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055335 Jun 21 19:18:03.013999 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 580/1149] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 19:18:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:18:03.674321 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:03.675151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:03.683871 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:03.684493 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:03.685459 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:03.685980 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:04.071908 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:04.087080 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-9332809d-f066-4682-866c-af7fecd49735 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1756 microversion: 2.1 time: 0.416805 Jun 21 19:18:04.088719 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 570/1150] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:03 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1756 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:04.851804 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-606532333", "imageRef": "52b12ff1-3e5a-4545-96b8-67d8969a2e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e9591ce-30ff-4920-8896-3d382a8c79e7"}], "security_groups": [{"name": "tempest-securitygroup--657749005"}], "key_name": "tempest-keypair-1809019199", "user_data": "}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:04.978346 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.network.neutron [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] validate_networks() for [('8e9591ce-30ff-4920-8896-3d382a8c79e7', None, None, None, None, None)] {{(pid=117619) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 19:18:05.112130 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:05.112897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:05.120450 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:05.121076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:05.122175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:05.122732 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:05.128610 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:05.497556 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:05.507511 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-7af0333e-6abb-4204-a557-5471de48201c tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1759 microversion: 2.1 time: 0.399257 Jun 21 19:18:05.519723 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 571/1151] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:05 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1759 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:05.679772 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 19:18:05.680349 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image limits 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 19:18:05.680709 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Flavor pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 19:18:05.681196 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Image pref 0:0:0 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 19:18:05.682283 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.virt.hardware [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117619) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 19:18:05.692485 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:05.692967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:05.693855 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:05.694293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:05.716424 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 19:18:05.721343 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.quota [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Getting quotas for user 25945373ee26489e8014f07ec27d81f7 and project d197f69e1d4b49d0801e6b625599aad8. Resources: {'instances', 'cores', 'ram'} {{(pid=117619) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 19:18:05.734598 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Going to run 1 instances... {{(pid=117619) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 19:18:05.736968 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52b12ff1-3e5a-4545-96b8-67d8969a2e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117619) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 19:18:05.815834 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-4e5e3bcd-ae21-49eb-be68-2bbe69e3fca5 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.968943 Jun 21 19:18:05.816848 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 581/1152] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 19:18:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 19:18:05.834655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e0f736df-38a7-43fe-92a4-f7888b429a72 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:05.835779 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e0f736df-38a7-43fe-92a4-f7888b429a72 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:05.928192 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-e0f736df-38a7-43fe-92a4-f7888b429a72 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:05.941828 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e0f736df-38a7-43fe-92a4-f7888b429a72 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1241 microversion: 2.1 time: 0.114205 Jun 21 19:18:05.942879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 572/1153] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:05 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:06.966496 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:06.967840 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:06.981307 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:06.982056 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:06.983429 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:06.986368 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:07.122266 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:07.131571 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a2a0fa74-8989-40f9-aae9-e0728e2f308c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1299 microversion: 2.1 time: 0.174281 Jun 21 19:18:07.132174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 582/1154] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:06 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:08.152540 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:08.154506 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:08.164880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:08.165883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:08.166991 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:08.167646 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:08.471825 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:08.481696 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-93b7e3d3-773e-409a-a7fa-e638f702047c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.335802 Jun 21 19:18:08.482335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 573/1155] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:08 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:09.137982 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-52589e12-0620-43a1-9e21-ab2f05566fc3 req-9ec07ff0-0f7a-49ed-a756-2a32bfb38408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b05566-3eb7-42be-b92a-129ff6ee74fe", "tag": "63391625-8d2f-4acf-a5b5-ddc5052cbe3d"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:09.155741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-52589e12-0620-43a1-9e21-ab2f05566fc3 req-9ec07ff0-0f7a-49ed-a756-2a32bfb38408 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:09.156597 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-52589e12-0620-43a1-9e21-ab2f05566fc3 req-9ec07ff0-0f7a-49ed-a756-2a32bfb38408 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:09.180321 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-52589e12-0620-43a1-9e21-ab2f05566fc3 req-9ec07ff0-0f7a-49ed-a756-2a32bfb38408 service nova] Creating event network-changed:63391625-8d2f-4acf-a5b5-ddc5052cbe3d for instance b4b05566-3eb7-42be-b92a-129ff6ee74fe on hv-cinder-84630 Jun 21 19:18:09.188383 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-52589e12-0620-43a1-9e21-ab2f05566fc3 req-9ec07ff0-0f7a-49ed-a756-2a32bfb38408 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055333 Jun 21 19:18:09.189850 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 583/1156] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:18:09.502638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:09.504047 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:09.516168 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:09.516638 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:09.518017 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:09.518658 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:09.756331 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:09.769934 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-1e01d678-8ac4-4fe1-a174-018c15293b31 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.273237 Jun 21 19:18:09.770879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 574/1157] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:09 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:10.795533 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:10.796240 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:10.804386 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:10.804890 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:10.805806 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:10.806364 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:10.953842 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:10.963632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-576232bf-4631-435d-acde-5812b8887bb8 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.173067 Jun 21 19:18:10.964293 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 584/1158] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:10 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:11.982478 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:11.983052 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:11.990050 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:11.990483 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:11.991279 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:11.991712 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:12.261887 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:12.270883 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-80b36dcd-5c36-438e-87a8-762421b95598 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.293280 Jun 21 19:18:12.276152 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 575/1159] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:11 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:13.297605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:13.298332 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:13.305601 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:13.306090 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:13.306883 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:13.307322 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:13.474275 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:13.488165 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-3cb3c5df-6c72-43e0-af00-dee5089dff43 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.194402 Jun 21 19:18:13.489206 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 585/1160] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:13 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:14.507108 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:14.507741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:14.515171 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:14.515625 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:14.516409 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:14.516851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:14.661863 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:14.669761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-07c2ecf3-db92-42c6-887a-b9d37e593298 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.166435 Jun 21 19:18:14.670633 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 576/1161] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:14 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:15.591787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-c538eb91-f09b-4dbe-a7e6-1160f718f3c5 req-12503f2e-7ed9-412e-9638-973a2f4ba680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b05566-3eb7-42be-b92a-129ff6ee74fe", "name": "network-vif-plugged", "status": "completed", "tag": "63391625-8d2f-4acf-a5b5-ddc5052cbe3d"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:15.600921 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c538eb91-f09b-4dbe-a7e6-1160f718f3c5 req-12503f2e-7ed9-412e-9638-973a2f4ba680 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:15.601397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-c538eb91-f09b-4dbe-a7e6-1160f718f3c5 req-12503f2e-7ed9-412e-9638-973a2f4ba680 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:15.620788 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-c538eb91-f09b-4dbe-a7e6-1160f718f3c5 req-12503f2e-7ed9-412e-9638-973a2f4ba680 service nova] Creating event network-vif-plugged:63391625-8d2f-4acf-a5b5-ddc5052cbe3d for instance b4b05566-3eb7-42be-b92a-129ff6ee74fe on hv-cinder-84630 Jun 21 19:18:15.629619 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-c538eb91-f09b-4dbe-a7e6-1160f718f3c5 req-12503f2e-7ed9-412e-9638-973a2f4ba680 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041561 Jun 21 19:18:15.630912 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 586/1162] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:18:15.691449 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:15.692151 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:15.700338 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:15.700789 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:15.701601 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:15.702068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:15.882097 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:15.892105 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-df269479-442e-4b03-8642-54034bbfa22f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.208571 Jun 21 19:18:15.892705 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 577/1163] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:15 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:18:16.914088 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=2 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:16.914995 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell0:SELECT=10 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:16.920047 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:16.920858 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:16.923540 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:16.932044 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:16.932496 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:16.933325 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:16.933768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:16.937465 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:17.094888 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:17.102895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-b5bdcb7d-2c0c-4c9c-a842-64924aa6370f tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1366 microversion: 2.1 time: 0.189755 Jun 21 19:18:17.103989 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 587/1164] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:16 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:18.128810 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:18.129474 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:18.131480 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell0:SELECT=2 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:18.132680 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:18:18.139019 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:18.139471 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:18.140251 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:18.140689 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:18.291851 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:18:18.299796 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-13ca3310-8e0e-4a9e-8635-272e31f86e5a tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1556 microversion: 2.1 time: 0.174845 Jun 21 19:18:18.300371 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 578/1165] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:18:18 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:18:18.317289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:18:18.317928 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:18:18.325290 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:18.325686 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:18.326531 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:18.327209 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:18.431668 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-0cee0c57-da7c-49ad-a4ae-4e48afa0d82c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118217 Jun 21 19:18:18.432579 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 588/1166] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 19:18:18 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:18:19.469570 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-6fb72dcd-e2e6-47dd-92d7-3c731650b293 req-261ff515-96b3-4716-b097-c6857afc3c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b05566-3eb7-42be-b92a-129ff6ee74fe", "tag": "63391625-8d2f-4acf-a5b5-ddc5052cbe3d"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:18:19.479414 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6fb72dcd-e2e6-47dd-92d7-3c731650b293 req-261ff515-96b3-4716-b097-c6857afc3c5c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:18:19.479853 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-6fb72dcd-e2e6-47dd-92d7-3c731650b293 req-261ff515-96b3-4716-b097-c6857afc3c5c service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:18:19.495639 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-6fb72dcd-e2e6-47dd-92d7-3c731650b293 req-261ff515-96b3-4716-b097-c6857afc3c5c service nova] Creating event network-changed:63391625-8d2f-4acf-a5b5-ddc5052cbe3d for instance b4b05566-3eb7-42be-b92a-129ff6ee74fe on hv-cinder-84630 Jun 21 19:18:19.501628 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-6fb72dcd-e2e6-47dd-92d7-3c731650b293 req-261ff515-96b3-4716-b097-c6857afc3c5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Jun 21 19:18:19.502299 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 579/1167] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:19:09.034088 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=3 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:09.034845 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=9 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:09.039312 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2064628461"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:09.039852 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:09.046651 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:09.047106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:09.047899 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:09.048339 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:09.182712 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.network.security_group_api [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Removing security group 77c4b153-6cf3-41da-b027-9216498f9b87 from port feef2fe6-388a-46b8-b3dc-0d004781e3b3 Jun 21 19:19:09.545068 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=3 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:09.545834 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=42 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:09.548059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ef3697e7-b194-40c8-8e40-05a60df3ff6d tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action" status: 202 len: 0 microversion: 2.1 time: 0.513077 Jun 21 19:19:09.551982 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 589/1168] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 19:19:09 2022] POST /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:19:09.633634 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-e2fefbd8-970e-47b6-9bb5-718a23115c47 req-799f40cb-412d-4a61-8626-85fd20a3d5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:09.646782 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e2fefbd8-970e-47b6-9bb5-718a23115c47 req-799f40cb-412d-4a61-8626-85fd20a3d5f1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:09.647547 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-e2fefbd8-970e-47b6-9bb5-718a23115c47 req-799f40cb-412d-4a61-8626-85fd20a3d5f1 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:09.661604 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-e2fefbd8-970e-47b6-9bb5-718a23115c47 req-799f40cb-412d-4a61-8626-85fd20a3d5f1 service nova] Creating event network-changed:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:19:09.668161 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-e2fefbd8-970e-47b6-9bb5-718a23115c47 req-799f40cb-412d-4a61-8626-85fd20a3d5f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124635 Jun 21 19:19:09.669637 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 580/1169] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:10.745202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:10.745787 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:10.753249 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:10.753783 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:10.754741 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:10.755183 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:10.815988 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [req-56ea9d6c-5f7c-4709-b0ea-7dfd783f05a9 req-fb6eb263-d47e-4a59-83c0-090301bb4793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:10.826309 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-56ea9d6c-5f7c-4709-b0ea-7dfd783f05a9 req-fb6eb263-d47e-4a59-83c0-090301bb4793 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:10.826749 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [req-56ea9d6c-5f7c-4709-b0ea-7dfd783f05a9 req-fb6eb263-d47e-4a59-83c0-090301bb4793 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:10.838087 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.compute.server_external_events [req-56ea9d6c-5f7c-4709-b0ea-7dfd783f05a9 req-fb6eb263-d47e-4a59-83c0-090301bb4793 service nova] Creating event network-changed:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:19:10.843476 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [req-56ea9d6c-5f7c-4709-b0ea-7dfd783f05a9 req-fb6eb263-d47e-4a59-83c0-090301bb4793 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101488 Jun 21 19:19:10.844577 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 581/1170] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 19:19:10.845397 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.objects.instance [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lazy-loading 'services' on Instance uuid cd33c616-0921-47a6-b8b1-e856750c210b {{(pid=117619) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:19:10.935865 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-fe9d84d5-3983-4100-85a0-24583a2e7f32 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments/0438a50d-860a-4b0d-b3d7-a5c01c914e6d" status: 202 len: 0 microversion: 2.1 time: 0.195167 Jun 21 19:19:10.936379 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 590/1171] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:19:10 2022] DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments/0438a50d-860a-4b0d-b3d7-a5c01c914e6d => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:19:10.950155 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:10.951875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:10.961128 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:10.961926 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:10.962907 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:10.963534 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:11.002327 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-63f26c65-e5b8-43e5-a2e6-13aa04d98bd2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059729 Jun 21 19:19:11.003180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 582/1172] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:19:10 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:12.015980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:12.016891 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:12.024221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:12.025255 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:12.026051 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:12.026503 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:12.053808 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-d404529c-e6d8-4824-a428-b0704320d4f5 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042765 Jun 21 19:19:12.054359 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 591/1173] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:19:12 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:19:12.064092 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:12.064590 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:12.071784 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:12.072233 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:12.072984 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:12.073446 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:12.147739 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] HTTP exception thrown: Instance cd33c616-0921-47a6-b8b1-e856750c210b is not attached to volume 0438a50d-860a-4b0d-b3d7-a5c01c914e6d Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Request method failure captured: Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments/0438a50d-860a-4b0d-b3d7-a5c01c914e6d HTTP/1.1 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishjgt_khKz3b9lQFASTUnVuNDylb0CPptu81HF889pDka8TJJig4I6M0Y1_dxzi8K7L82OacQwseotUjQk6jnfBxamtVerh_QS8tXA-QnOq2GQDJi5VZLs9Jpd2yjuu69GsfiEiuFWaO1mLKqIk_V5VS8ZrTVbwV7MX-bCXTpuRkcM0 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 193a4ca8d19f449588f3b46389c14f06 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:12.150880 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/193a4ca8d19f449588f3b46389c14f06"}]}] Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 193a4ca8d19f449588f3b46389c14f06 Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestMinimumBasicScenario-1498873631-project Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: e334063c001a4435940d7cf850ec350f Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestMinimumBasicScenario-1498873631-project Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:12.152647 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance cd33c616-0921-47a6-b8b1-e856750c210b is not attached to volume 0438a50d-860a-4b0d-b3d7-a5c01c914e6d Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'server_id': 'cd33c616-0921-47a6-b8b1-e856750c210b', 'id': '0438a50d-860a-4b0d-b3d7-a5c01c914e6d'} Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0438a50d-860a-4b0d-b3d7-a5c01c914e6d. Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:12.153801 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd33c616-0921-47a6-b8b1-e856750c210b is not attached to volume 0438a50d-860a-4b0d-b3d7-a5c01c914e6d Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd33c616-0921-47a6-b8b1-e856750c210b is not attached to volume 0438a50d-860a-4b0d-b3d7-a5c01c914e6d Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:12.155382 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Returning 404 to user: Instance cd33c616-0921-47a6-b8b1-e856750c210b is not attached to volume 0438a50d-860a-4b0d-b3d7-a5c01c914e6d {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:12.156715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-e21ce8d5-32f7-4aa5-9c6d-65cb9d917cbf tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments/0438a50d-860a-4b0d-b3d7-a5c01c914e6d" status: 404 len: 154 microversion: 2.1 time: 0.092201 Jun 21 19:19:12.156715 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 583/1174] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:19:12 2022] DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b/os-volume_attachments/0438a50d-860a-4b0d-b3d7-a5c01c914e6d => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:13.288493 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:13.289015 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:13.295810 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:13.296257 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:13.297021 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:13.297607 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:13.321980 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:19:13.400036 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-719bcac3-5d27-474e-b614-dc756ab289f4 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 204 len: 0 microversion: 2.1 time: 0.114275 Jun 21 19:19:13.400636 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 592/1175] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:13 2022] DELETE /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:19:13.408842 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:13.409489 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:13.416076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:13.416530 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:13.417358 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:13.417799 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:13.576139 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:13.583968 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c2091ff4-c28f-4667-9739-77350c66d1e2 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1553 microversion: 2.1 time: 0.179029 Jun 21 19:19:13.584588 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 584/1176] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:13 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:19:14.602176 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:14.602768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:14.609791 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:14.610237 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:14.611009 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:14.611436 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:14.757600 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:14.767829 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1681e743-f1e8-4a7a-bd13-0ca7e9b41b07 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1553 microversion: 2.1 time: 0.169785 Jun 21 19:19:14.768605 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 593/1177] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:14 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:19:15.787349 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:15.788058 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:15.795000 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:15.795451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:15.796262 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:15.796697 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:15.999246 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e334063c001a4435940d7cf850ec350f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193a4ca8d19f449588f3b46389c14f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:16.007965 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-70d5e334-1c88-437c-b7f0-ef10f3b9ed84 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 200 len: 1553 microversion: 2.1 time: 0.224749 Jun 21 19:19:16.017264 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 585/1178] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:15 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 19:19:16.092221 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-0f7caeee-6a9d-48e2-b665-f55b13802c76 req-679699d3-f2f7-4170-a34f-86cf55a28e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd33c616-0921-47a6-b8b1-e856750c210b", "name": "network-vif-deleted", "tag": "feef2fe6-388a-46b8-b3dc-0d004781e3b3"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:16.103507 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-0f7caeee-6a9d-48e2-b665-f55b13802c76 req-679699d3-f2f7-4170-a34f-86cf55a28e64 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:16.103967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-0f7caeee-6a9d-48e2-b665-f55b13802c76 req-679699d3-f2f7-4170-a34f-86cf55a28e64 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:16.116407 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-0f7caeee-6a9d-48e2-b665-f55b13802c76 req-679699d3-f2f7-4170-a34f-86cf55a28e64 service nova] Creating event network-vif-deleted:feef2fe6-388a-46b8-b3dc-0d004781e3b3 for instance cd33c616-0921-47a6-b8b1-e856750c210b on hv-cinder-84630 Jun 21 19:19:16.122390 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-0f7caeee-6a9d-48e2-b665-f55b13802c76 req-679699d3-f2f7-4170-a34f-86cf55a28e64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Jun 21 19:19:16.122997 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 594/1179] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:17.027064 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:17.027694 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] [instance: cd33c616-0921-47a6-b8b1-e856750c210b] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:17.034488 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:17.034943 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:17.035721 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:17.036163 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:17.050180 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] HTTP exception thrown: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Request method failure captured: Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b HTTP/1.1 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishjgt_khKz3b9lQFASTUnVuNDylb0CPptu81HF889pDka8TJJig4I6M0Y1_dxzi8K7L82OacQwseotUjQk6jnfBxamtVerh_QS8tXA-QnOq2GQDJi5VZLs9Jpd2yjuu69GsfiEiuFWaO1mLKqIk_V5VS8ZrTVbwV7MX-bCXTpuRkcM0 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: 193a4ca8d19f449588f3b46389c14f06 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:17.051792 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/193a4ca8d19f449588f3b46389c14f06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/193a4ca8d19f449588f3b46389c14f06"}]}] Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: 193a4ca8d19f449588f3b46389c14f06 Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1498873631 Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-TestMinimumBasicScenario-1498873631-project Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: e334063c001a4435940d7cf850ec350f Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-TestMinimumBasicScenario-1498873631-project Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. Jun 21 19:19:17.054076 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'cd33c616-0921-47a6-b8b1-e856750c210b'} Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:17.055175 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. Jun 21 19:19:17.056668 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:17.057962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Returning 404 to user: Instance cd33c616-0921-47a6-b8b1-e856750c210b could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:17.057962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-ebd650b5-41ef-4fde-8aa2-4c8865bb6847 tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b" status: 404 len: 111 microversion: 2.1 time: 0.030695 Jun 21 19:19:17.057962 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 586/1180] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:17 2022] GET /compute/v2.1/servers/cd33c616-0921-47a6-b8b1-e856750c210b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:17.063523 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-1f2637a3-b0a9-4265-9f24-f1366984bead tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] Calling method '.version_select at 0x7f3595b3e8b0>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:17.084656 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-1f2637a3-b0a9-4265-9f24-f1366984bead tempest-TestMinimumBasicScenario-1498873631 tempest-TestMinimumBasicScenario-1498873631-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-448146508" status: 202 len: 0 microversion: 2.1 time: 0.025124 Jun 21 19:19:17.085707 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 595/1181] 10.222.0.70 () {58 vars in 1268 bytes} [Tue Jun 21 19:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-448146508 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:19:39.338264 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:39.338848 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:39.341066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_api:SELECT=14 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:39.341747 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG dbcounter [-] [117618] Writing DB stats nova_cell1:SELECT=30 {{(pid=117618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:39.348095 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:39.348545 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:39.349360 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:39.349800 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:39.374623 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-bd9f5ee4-500c-48e6-9b5d-9138411fc4f3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/ips" status: 200 len: 150 microversion: 2.1 time: 0.040603 Jun 21 19:19:39.375199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 587/1182] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 19:19:39 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:40.691680 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:40.692415 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG dbcounter [-] [117619] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 19:19:40.696593 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6f173dd-637e-4775-b242-c567ae87caad"}} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:40.698603 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:40.707631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:40.708071 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:40.708831 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:40.709289 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:40.952975 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ae8dc81d-601b-4566-b406-b6ba7d91bca3 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "POST /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262389 Jun 21 19:19:40.953654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 596/1183] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 19:19:40 2022] POST /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:48.645053 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:48.645836 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:48.652439 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:48.652879 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:48.653714 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:48.654146 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:48.755249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.objects.instance [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lazy-loading 'services' on Instance uuid b4b05566-3eb7-42be-b92a-129ff6ee74fe {{(pid=117618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 19:19:48.867266 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-884cc0c2-49a5-49ac-a3a3-216a37818a0d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments/a6f173dd-637e-4775-b242-c567ae87caad" status: 202 len: 0 microversion: 2.1 time: 0.226526 Jun 21 19:19:48.868167 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 588/1184] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 19:19:48 2022] DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments/a6f173dd-637e-4775-b242-c567ae87caad => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:19:48.878950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:48.880751 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:48.888132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:48.888620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:48.890174 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:48.890653 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:48.942334 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-2f1feb18-b10f-49a1-b7dd-4c155bafb91d tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068117 Jun 21 19:19:48.943296 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 597/1185] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:19:48 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:49.956913 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:49.958118 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:49.965199 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:49.965659 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:49.966447 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:49.966882 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:50.001640 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-592f0025-864e-44b0-baf7-4017c0debfa6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049624 Jun 21 19:19:50.002218 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 589/1186] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 19:19:49 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 19:19:50.068301 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:50.068933 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:50.076768 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:50.077485 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:50.078785 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:50.079294 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:50.111854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Going to try to terminate instance {{(pid=117619) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 19:19:50.212861 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-a08ca0cb-12ac-4192-b714-974757f2f70b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 204 len: 0 microversion: 2.1 time: 0.148095 Jun 21 19:19:50.214048 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 598/1187] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:50 2022] DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 19:19:50.229946 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:50.230961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:50.237797 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:50.238335 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:50.239206 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:50.239681 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:50.415359 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:50.424153 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a7aa850c-4054-4a42-a72e-4b26586d241b tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1681 microversion: 2.1 time: 0.201403 Jun 21 19:19:50.424741 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 590/1188] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:50 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:19:51.442522 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:51.443276 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:51.452132 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:51.452628 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:51.453502 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:51.453988 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:51.607067 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.policy [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117619) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:51.615059 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ffa8b4d4-c1b4-428a-be02-57fee3280294 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1681 microversion: 2.1 time: 0.176767 Jun 21 19:19:51.615650 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 599/1189] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:51 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:19:52.641008 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:52.641897 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:52.649004 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:52.649599 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:52.650539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:52.651072 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:52.889269 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.policy [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25945373ee26489e8014f07ec27d81f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd197f69e1d4b49d0801e6b625599aad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117618) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 19:19:52.899016 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-2b294420-41ba-44ad-a674-b4499902ca52 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 200 len: 1681 microversion: 2.1 time: 0.262047 Jun 21 19:19:52.899606 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 591/1190] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:52 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 19:19:53.369482 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [req-0b9b5de7-5cfa-4078-8e93-135e988496b8 req-11c180c4-41d0-4e3d-a50d-faa8cf222c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b05566-3eb7-42be-b92a-129ff6ee74fe", "name": "network-vif-deleted", "tag": "63391625-8d2f-4acf-a5b5-ddc5052cbe3d"}]} {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 19:19:53.383748 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-0b9b5de7-5cfa-4078-8e93-135e988496b8 req-11c180c4-41d0-4e3d-a50d-faa8cf222c65 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:53.384554 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [req-0b9b5de7-5cfa-4078-8e93-135e988496b8 req-11c180c4-41d0-4e3d-a50d-faa8cf222c65 service nova] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:53.407941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.compute.server_external_events [req-0b9b5de7-5cfa-4078-8e93-135e988496b8 req-11c180c4-41d0-4e3d-a50d-faa8cf222c65 service nova] Creating event network-vif-deleted:63391625-8d2f-4acf-a5b5-ddc5052cbe3d for instance b4b05566-3eb7-42be-b92a-129ff6ee74fe on hv-cinder-84630 Jun 21 19:19:53.425873 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [req-0b9b5de7-5cfa-4078-8e93-135e988496b8 req-11c180c4-41d0-4e3d-a50d-faa8cf222c65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055447 Jun 21 19:19:53.430231 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 600/1191] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 19:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 19:19:53.923972 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:53.924924 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:53.932406 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:53.932928 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:53.933811 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:53.934249 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:53.955214 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe HTTP/1.1 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:53.957288 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:53.959272 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b4b05566-3eb7-42be-b92a-129ff6ee74fe'} Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:53.960560 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:53.962539 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:53.964876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:53.964876 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-cc5df744-afb4-4451-8194-fdccd8511728 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 404 len: 111 microversion: 2.1 time: 0.039218 Jun 21 19:19:53.970854 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-5179532b-865f-4db0-9b0d-32d6107aa3fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '.version_select at 0x7f3595ace940>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:53.974066 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 592/1192] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:53 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:53.991162 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-5179532b-865f-4db0-9b0d-32d6107aa3fb tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809019199" status: 202 len: 0 microversion: 2.1 time: 0.024666 Jun 21 19:19:53.991685 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 601/1193] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 19:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809019199 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 19:19:55.964112 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:55.964682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:55.970875 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:55.971318 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:55.972070 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:55.972501 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:55.986102 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe HTTP/1.1 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:55.987682 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:55.989445 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b4b05566-3eb7-42be-b92a-129ff6ee74fe'} Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:55.990479 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:55.992228 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:55.994386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:55.994386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-c7951738-59ce-4e84-bdb4-682d37b03c76 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 404 len: 111 microversion: 2.1 time: 0.028838 Jun 21 19:19:55.994386 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 593/1194] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:55 2022] DELETE /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:55.998941 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:55.999674 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b4b05566-3eb7-42be-b92a-129ff6ee74fe] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:56.005758 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:56.006202 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:56.006967 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:56.007399 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:56.020742 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe HTTP/1.1 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:19:56.022412 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:56.024129 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'b4b05566-3eb7-42be-b92a-129ff6ee74fe'} Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:56.025169 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. Jun 21 19:19:56.026753 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:56.028143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b4b05566-3eb7-42be-b92a-129ff6ee74fe could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:56.028143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-93c0a1b0-3133-4eed-a75a-92395f7653bd tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe" status: 404 len: 111 microversion: 2.1 time: 0.029945 Jun 21 19:19:56.028143 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 602/1195] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:55 2022] GET /compute/v2.1/servers/b4b05566-3eb7-42be-b92a-129ff6ee74fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:57.160287 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:57.160850 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:57.167748 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.168193 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.168961 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.169426 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.183815 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f HTTP/1.1 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:57.185408 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.187111 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'c09c9c29-82b9-4d35-8022-04083404488f'} Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:57.188034 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.189664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.191518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:57.191518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-b2ec7728-dd37-4b89-b562-aea5e6bec7a1 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 404 len: 111 microversion: 2.1 time: 0.030540 Jun 21 19:19:57.191518 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 594/1196] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:57 2022] DELETE /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:57.195497 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:57.196112 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: c09c9c29-82b9-4d35-8022-04083404488f] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:57.203654 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.204101 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.204860 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.205344 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.219644 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f HTTP/1.1 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:19:57.221793 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.223558 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'c09c9c29-82b9-4d35-8022-04083404488f'} Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:57.224620 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. Jun 21 19:19:57.226599 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.228909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance c09c9c29-82b9-4d35-8022-04083404488f could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:57.228909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-da5eb0fd-21a9-4da5-82d3-6f4ed3d68bb7 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f" status: 404 len: 111 microversion: 2.1 time: 0.031898 Jun 21 19:19:57.228909 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 603/1197] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:57 2022] GET /compute/v2.1/servers/c09c9c29-82b9-4d35-8022-04083404488f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:57.232103 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:57.232761 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:57.239009 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.239588 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.240362 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.240803 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.255141 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 HTTP/1.1 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:57.256702 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.258979 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': 'b3bb88a5-7007-4d70-ad69-a0b2c4307f53'} Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:57.259973 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.262528 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.264157 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:57.264157 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-a2ecc9ce-cb3e-494d-ba11-13361735db5c tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 404 len: 111 microversion: 2.1 time: 0.029988 Jun 21 19:19:57.264157 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 595/1198] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:57 2022] DELETE /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:57.268340 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:57.268950 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: b3bb88a5-7007-4d70-ad69-a0b2c4307f53] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:57.275730 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.276231 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.276983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:57.277444 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:57.290640 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 HTTP/1.1 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:19:57.292060 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.293931 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': 'b3bb88a5-7007-4d70-ad69-a0b2c4307f53'} Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:57.294906 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. Jun 21 19:19:57.296498 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:57.298061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance b3bb88a5-7007-4d70-ad69-a0b2c4307f53 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:57.298061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-ecf8d1dc-4611-4030-b8fe-a3ce6127ed90 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53" status: 404 len: 111 microversion: 2.1 time: 0.029872 Jun 21 19:19:57.298061 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 604/1199] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:57 2022] GET /compute/v2.1/servers/b3bb88a5-7007-4d70-ad69-a0b2c4307f53 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:58.454247 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:58.455252 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.compute.api [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117618) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:58.467676 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:58.468470 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:58.469868 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:58.470612 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG oslo_concurrency.lockutils [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:58.491655 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.wsgi [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: request: DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 HTTP/1.1 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept: application/json Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Accept-Encoding: identity Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Connection: close Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Length: 0 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Content-Type: application/json Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Host: 10.222.0.70 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Openstack-System-Scope: None Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Id: None Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Domain-Name: None Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Identity-Status: Confirmed Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Is-Admin-Project: True Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Id: default Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Domain-Name: Default Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Role: reader,member Jun 21 19:19:58.493314 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Roles: reader,member Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Id: default Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Domain-Name: Default Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: method: > Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: exception: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.496559 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: action_args: {'id': '1a45ca17-da52-48bf-9d33-860f2652bd91'} Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: {{(pid=117618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:58.497929 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.500767 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.504143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: DEBUG nova.api.openstack.wsgi [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. {{(pid=117618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:58.504143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO nova.api.openstack.requestlog [None req-72fe599b-26d3-4ead-a488-facf5fc124c6 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 404 len: 111 microversion: 2.1 time: 0.048554 Jun 21 19:19:58.504143 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: [pid: 117618|app: 0|req: 596/1200] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 19:19:58 2022] DELETE /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:19:58.506744 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Calling method '>' {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 19:19:58.507367 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.compute.api [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] [instance: 1a45ca17-da52-48bf-9d33-860f2652bd91] Fetching instance by UUID {{(pid=117619) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 19:19:58.514671 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:58.515258 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:58.516187 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 19:19:58.516622 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG oslo_concurrency.lockutils [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Lock "bfe881bf-3b81-4d90-a9e4-cd38631b724f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 19:19:58.533868 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.wsgi [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] HTTP exception thrown: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Request method failure captured: Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: request: GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 HTTP/1.1 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept: application/json Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Accept-Encoding: identity Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Connection: close Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Length: 0 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Content-Type: application/json Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Host: 10.222.0.70 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Openstack-System-Scope: None Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: User-Agent: python-urllib3/1.26.9 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Auth-Token: gAAAAABishfDZXZyy2ZCW2NPAml7LgclnC2yCHVe4xz6Oft-BenWJMlNeb-hqERlHuzxpy8HDq-8UfD0ARRI3aQZRI0EoDHlI2HxMBHlFm3BsuCh8mxDAD3h8TSG-IpVw_BZladp8DOQARFccPv3qhisfM2JpQjpWNTlH39RijpHr8uR0zI9Kr8 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Id: None Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Domain-Name: None Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Identity-Status: Confirmed Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Is-Admin-Project: True Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Id: default Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Domain-Name: Default Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Role: reader,member Jun 21 19:19:58.536337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Roles: reader,member Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d197f69e1d4b49d0801e6b625599aad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d197f69e1d4b49d0801e6b625599aad8"}]}] Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Id: d197f69e1d4b49d0801e6b625599aad8 Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588284055 Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Id: default Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Domain-Name: Default Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Id: 25945373ee26489e8014f07ec27d81f7 Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: X-User-Name: tempest-AttachVolumeNegativeTest-1588284055-project Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: method: > Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: exception: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.539106 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: action_args: {'id': '1a45ca17-da52-48bf-9d33-860f2652bd91'} Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: {{(pid=117619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 19:19:58.540108 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. Jun 21 19:19:58.542543 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: ERROR nova.api.openstack.wsgi Jun 21 19:19:58.543983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: DEBUG nova.api.openstack.wsgi [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] Returning 404 to user: Instance 1a45ca17-da52-48bf-9d33-860f2652bd91 could not be found. {{(pid=117619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 19:19:58.543983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO nova.api.openstack.requestlog [None req-074391a1-7c3e-4729-882e-c7dc0e753f48 tempest-AttachVolumeNegativeTest-1588284055 tempest-AttachVolumeNegativeTest-1588284055-project] 10.222.0.70 "GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91" status: 404 len: 111 microversion: 2.1 time: 0.037378 Jun 21 19:19:58.543983 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: [pid: 117619|app: 0|req: 605/1201] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 19:19:58 2022] GET /compute/v2.1/servers/1a45ca17-da52-48bf-9d33-860f2652bd91 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 19:21:12.782261 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:21:12.782917 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:21:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:21:18.823709 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:21:18.824423 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:21:19.600946 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:21:19.601702 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:22:53.464667 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:22:53.465631 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:24:32.791028 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:24:32.791824 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:24:38.832656 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:24:38.833451 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:24:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:24:39.609655 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:24:39.610337 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:25:02.445341 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:25:02.446168 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:25:03.175664 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:25:03.176267 dv-cinder-846303-1-iscsi devstack@n-api.service[117618]: Tue Jun 21 19:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 19:26:13.476895 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 19:26:13.477632 dv-cinder-846303-1-iscsi devstack@n-api.service[117619]: Tue Jun 21 19:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!